Aug 16 19:53:20 user nova-compute[72894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 19:53:23 user nova-compute[72894]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72894) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72894) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72894) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 19:53:23 user nova-compute[72894]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:53:23 user nova-compute[72894]: INFO nova.virt.driver [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 19:53:23 user nova-compute[72894]: INFO nova.compute.provider_config [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Acquiring lock "singleton_lock" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Acquired lock "singleton_lock" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Releasing lock "singleton_lock" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Full set of CONF: {{(pid=72894) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ******************************************************************************** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Configuration options gathered from: {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ================================================================================ {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] allow_resize_to_same_host      = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] arq_binding_timeout            = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] backdoor_port                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] backdoor_socket                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] block_device_allocate_retries  = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] block_device_allocate_retries_interval = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cert                           = self.pem {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute_monitors               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] config_dir                     = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] config_drive_format            = iso9660 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] config_source                  = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] console_host                   = user {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] control_exchange               = nova {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cpu_allocation_ratio           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] daemon                         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] debug                          = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] default_access_ip_network_name = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] default_availability_zone      = nova {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] default_ephemeral_format       = ext4 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] default_schedule_zone          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] disk_allocation_ratio          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] enable_new_services            = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] enabled_ssl_apis               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] flat_injected                  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] force_config_drive             = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] force_raw_images               = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] graceful_shutdown_timeout      = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] heal_instance_info_cache_interval = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] host                           = user {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_build_timeout         = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_delete_interval       = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_name_template         = instance-%08x {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_usage_audit           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_usage_audit_period    = month {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] internal_service_availability_zone = internal {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] key                            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] live_migration_retry_count     = 30 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_config_append              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_dir                        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_file                       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_options                    = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_rotate_interval            = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_rotate_interval_type       = days {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] log_rotation_type              = none {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] long_rpc_timeout               = 1800 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_concurrent_builds          = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_concurrent_live_migrations = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_concurrent_snapshots       = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_local_block_devices        = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_logfile_count              = 30 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] max_logfile_size_mb            = 200 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] maximum_instance_delete_attempts = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metadata_listen                = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metadata_listen_port           = 8775 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metadata_workers               = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] migrate_max_retries            = -1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] mkisofs_cmd                    = genisoimage {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] my_ip                          = 10.0.0.210 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] network_allocate_retries       = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] osapi_compute_listen_port      = 8774 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] osapi_compute_unique_server_name_scope =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] osapi_compute_workers          = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] password_length                = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] periodic_enable                = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] periodic_fuzzy_delay           = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] pointer_model                  = ps2mouse {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] preallocate_images             = none {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] publish_errors                 = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] pybasedir                      = /opt/stack/nova {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ram_allocation_ratio           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rate_limit_burst               = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rate_limit_except_level        = CRITICAL {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rate_limit_interval            = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reboot_timeout                 = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reclaim_instance_interval      = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] record                         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reimage_timeout_per_gb         = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] report_interval                = 120 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rescue_timeout                 = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reserved_host_cpus             = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reserved_host_disk_mb          = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reserved_host_memory_mb        = 512 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] reserved_huge_pages            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] resize_confirm_window          = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] resize_fs_using_block_device   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] resume_guests_state_on_host_boot = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rpc_response_timeout           = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] run_external_periodic_tasks    = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] running_deleted_instance_action = reap {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] running_deleted_instance_timeout = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler_instance_sync_interval = 120 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_down_time              = 720 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] servicegroup_driver            = db {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] shelved_offload_time           = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] shelved_poll_interval          = 3600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] shutdown_timeout               = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] source_is_ipv6                 = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ssl_only                       = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] state_path                     = /opt/stack/data/nova {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] sync_power_state_interval      = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] sync_power_state_pool_size     = 1000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] syslog_log_facility            = LOG_USER {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] tempdir                        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] timeout_nbd                    = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] transport_url                  = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] update_resources_interval      = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_cow_images                 = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_eventlog                   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_journal                    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_json                       = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_rootwrap_daemon            = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_stderr                     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] use_syslog                     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vcpu_pin_set                   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plugging_is_fatal          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plugging_timeout           = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] virt_mkfs                      = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] volume_usage_poll_interval     = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] watch_log_file                 = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] web                            = /usr/share/spice-html5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_concurrency.disable_process_locking = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.auth_strategy              = keystone {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.compute_link_prefix        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.dhcp_domain                = novalocal {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.enable_instance_password   = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.glance_link_prefix         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.instance_list_per_project_cells = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.list_records_by_skipping_down_cells = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.local_metadata_per_cell    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.max_limit                  = 1000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.metadata_cache_expiration  = 15 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.neutron_default_tenant_id  = default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.use_forwarded_for          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.use_neutron_default_nets   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_dynamic_targets = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_jsonfile_path   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.backend_argument         = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.config_prefix            = cache.oslo {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.dead_timeout             = 60.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.debug_cache_backend      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.enable_retry_client      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.enable_socket_keepalive  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.enabled                  = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.expiration_time          = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.hashclient_retry_attempts = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_dead_retry      = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_password        =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_sasl_enabled    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.memcache_username        =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.proxies                  = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.retry_attempts           = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.retry_delay              = 0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.socket_keepalive_count   = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.socket_keepalive_idle    = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.socket_keepalive_interval = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.tls_allowed_ciphers      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.tls_cafile               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.tls_certfile             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.tls_enabled              = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cache.tls_keyfile              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.auth_section            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.auth_type               = password {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.cafile                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.certfile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.collect_timing          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.cross_az_attach         = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.debug                   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.endpoint_template       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.http_retries            = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.insecure                = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.keyfile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.os_region_name          = RegionOne {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.split_loggers           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cinder.timeout                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.cpu_dedicated_set      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.cpu_shared_set         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.image_type_exclude_list = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.resource_provider_association_refresh = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.shutdown_retry_interval = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] conductor.workers              = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] console.allowed_origins        = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] console.ssl_ciphers            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] console.ssl_minimum_version    = default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] consoleauth.token_ttl          = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.cafile                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.certfile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.collect_timing          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.connect_retries         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.connect_retry_delay     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.endpoint_override       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.insecure                = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.keyfile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.max_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.min_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.region_name             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.service_name            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.service_type            = accelerator {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.split_loggers           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.status_code_retries     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.timeout                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] cyborg.version                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.backend               = sqlalchemy {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.connection            = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.connection_debug      = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.connection_parameters =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.connection_recycle_time = 3600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.connection_trace      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.db_inc_retry_interval = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.db_max_retries        = 20 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.db_max_retry_interval = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.db_retry_interval     = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.max_overflow          = 50 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.max_pool_size         = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.max_retries           = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.mysql_enable_ndb      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.mysql_wsrep_sync_wait = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.pool_timeout          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.retry_interval        = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.slave_connection      = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] database.sqlite_synchronous    = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.backend           = sqlalchemy {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.connection        = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.connection_debug  = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.connection_parameters =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.connection_recycle_time = 3600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.connection_trace  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.db_inc_retry_interval = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.db_max_retries    = 20 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.db_max_retry_interval = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.db_retry_interval = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.max_overflow      = 50 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.max_pool_size     = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.max_retries       = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.mysql_enable_ndb  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.pool_timeout      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.retry_interval    = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.slave_connection  = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] api_database.sqlite_synchronous = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] devices.enabled_mdev_types     = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ephemeral_storage_encryption.enabled = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.api_servers             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.cafile                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.certfile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.collect_timing          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.connect_retries         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.connect_retry_delay     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.debug                   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.default_trusted_certificate_ids = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.enable_certificate_validation = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.enable_rbd_download     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.endpoint_override       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.insecure                = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.keyfile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.max_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.min_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.num_retries             = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.rbd_ceph_conf           =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.rbd_connect_timeout     = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.rbd_pool                =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.rbd_user                =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.region_name             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.service_name            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.service_type            = image {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.split_loggers           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.status_code_retries     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.timeout                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.verify_glance_signatures = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] glance.version                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] guestfs.debug                  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.config_drive_cdrom      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.config_drive_inject_password = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.enable_remotefx         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.instances_path_share    =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.limit_cpu_features      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.use_multipath_io        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.vswitch_name            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] mks.enabled                    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.manager_interval   = 2400 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.precache_concurrency = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.remove_unused_base_images = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] image_cache.subdirectory_name  = _base {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.api_max_retries         = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.api_retry_interval      = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.auth_section            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.auth_type               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.cafile                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.certfile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.collect_timing          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.connect_retries         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.connect_retry_delay     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.endpoint_override       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.insecure                = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.keyfile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.max_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.min_version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.partition_key           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.peer_list               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.region_name             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.serial_console_state_timeout = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.service_name            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.service_type            = baremetal {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.split_loggers           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.status_code_retries     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.timeout                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ironic.version                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] key_manager.fixed_key          = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.barbican_api_version  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.barbican_endpoint     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.barbican_endpoint_type = public {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.barbican_region_name  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.cafile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.certfile              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.collect_timing        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.insecure              = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.keyfile               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.number_of_retries     = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.retry_delay           = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.send_service_user_token = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.split_loggers         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.timeout               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.verify_ssl            = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican.verify_ssl_path       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.auth_section = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.auth_type = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.cafile   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.certfile = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.collect_timing = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.insecure = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.keyfile  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.split_loggers = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] barbican_service_user.timeout  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.approle_role_id          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.approle_secret_id        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.cafile                   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.certfile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.collect_timing           = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.insecure                 = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.keyfile                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.kv_mountpoint            = secret {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.kv_version               = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.namespace                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.root_token_id            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.split_loggers            = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.ssl_ca_crt_file          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.timeout                  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.use_ssl                  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.cafile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.certfile              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.collect_timing        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.connect_retries       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.connect_retry_delay   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.endpoint_override     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.insecure              = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.keyfile               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.max_version           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.min_version           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.region_name           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.service_name          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.service_type          = identity {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.split_loggers         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.status_code_retries   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.timeout               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] keystone.version               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.connection_uri         =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_mode               = custom {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: WARNING oslo_config.cfg [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_power_governor_high = performance {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_power_management   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.device_detach_attempts = 8 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.device_detach_timeout  = 20 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.disk_cachemodes        = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.disk_prefix            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.enabled_perf_events    = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.file_backed_memory     = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.gid_maps               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.hw_disk_discard        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.hw_machine_type        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_rbd_pool        = rbd {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_type            = default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.images_volume_group    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.inject_key             = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.inject_partition       = -2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.inject_password        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.iscsi_iface            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.iser_use_multipath     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_downtime = 500 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_inbound_addr = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_scheme  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_timeout_action = abort {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_tunnelled = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: WARNING oslo_config.cfg [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 19:53:23 user nova-compute[72894]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 19:53:23 user nova-compute[72894]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 19:53:23 user nova-compute[72894]: and ``live_migration_inbound_addr`` respectively.
Aug 16 19:53:23 user nova-compute[72894]: ).  Its value may be silently ignored in the future.
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.live_migration_with_native_tls = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.max_queues             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.nfs_mount_options      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_pcie_ports         = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.pmem_namespaces        = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.quobyte_client_cfg     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rbd_secret_uuid        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rbd_user               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rescue_image_id        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rescue_kernel_id       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.rx_queue_size          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.smbfs_mount_options    =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.snapshot_compression   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.snapshot_image_format  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.sparse_logical_volumes = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.swtpm_enabled          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.swtpm_group            = tss {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.swtpm_user             = tss {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.sysinfo_serial         = unique {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.tb_cache_size          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.tx_queue_size          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.uid_maps               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.use_virtio_for_bridges = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.virt_type              = kvm {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.volume_clear           = zero {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.volume_clear_size      = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.volume_use_multipath   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_cache_path   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.auth_section           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.auth_type              = password {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.cafile                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.certfile               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.collect_timing         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.connect_retries        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.connect_retry_delay    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.default_floating_pool  = public {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.endpoint_override      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.extension_sync_interval = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.http_retries           = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.insecure               = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.keyfile                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.max_version            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.min_version            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.ovs_bridge             = br-int {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.physnets               = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.region_name            = RegionOne {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.service_metadata_proxy = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.service_name           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.service_type           = network {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.split_loggers          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.status_code_retries    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.timeout                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] neutron.version                = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] notifications.bdms_in_notifications = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] notifications.default_level    = INFO {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] notifications.notification_format = unversioned {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] notifications.notify_on_state_change = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] pci.alias                      = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] pci.device_spec                = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] pci.report_in_placement        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.auth_section         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.auth_type            = password {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.cafile               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.certfile             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.collect_timing       = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.connect_retries      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.connect_retry_delay  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.default_domain_id    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.default_domain_name  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.domain_id            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.domain_name          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.endpoint_override    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.insecure             = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.keyfile              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.max_version          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.min_version          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.password             = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.project_domain_id    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.project_domain_name  = Default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.project_id           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.project_name         = service {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.region_name          = RegionOne {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.service_name         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.service_type         = placement {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.split_loggers        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.status_code_retries  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.system_scope         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.timeout              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.trust_id             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.user_domain_id       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.user_domain_name     = Default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.user_id              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.username             = placement {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] placement.version              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.cores                    = 20 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.count_usage_from_placement = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.injected_file_content_bytes = 10240 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.injected_file_path_length = 255 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.injected_files           = 5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.instances                = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.key_pairs                = 100 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.metadata_items           = 128 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.ram                      = 51200 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.recheck_quota            = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.server_group_members     = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] quota.server_groups            = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rdp.enabled                    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.image_metadata_prefilter = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.max_attempts         = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.max_placement_results = 1000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] scheduler.workers              = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.host_subset_size = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.isolated_hosts = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.isolated_images = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.pci_in_placement = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.track_instance_changes = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metrics.required               = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metrics.weight_multiplier      = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] metrics.weight_setting         = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.enabled         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.port_range      = 10000:20000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] serial_console.serialproxy_port = 6083 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.auth_section      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.auth_type         = password {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.cafile            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.certfile          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.collect_timing    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.insecure          = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.keyfile           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.send_service_user_token = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.split_loggers     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] service_user.timeout           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.agent_enabled            = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.enabled                  = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.html5proxy_port          = 6082 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.image_compression        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.jpeg_compression         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.playback_compression     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.server_listen            = 127.0.0.1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.streaming_mode           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] spice.zlib_compression         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] upgrade_levels.baseapi         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] upgrade_levels.cert            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] upgrade_levels.compute         = auto {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] upgrade_levels.conductor       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] upgrade_levels.scheduler       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.cafile = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.certfile = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.insecure = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vendordata_dynamic_auth.timeout = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.api_retry_count         = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.ca_file                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.cache_prefix            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.cluster_name            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.connection_pool_size    = 10 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.console_delay_seconds   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.datastore_regex         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.host_ip                 = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.host_password           = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.host_port               = 443 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.host_username           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.insecure                = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.integration_bridge      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.maximum_objects         = 100 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.pbm_default_policy      = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.pbm_enabled             = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.pbm_wsdl_location       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.serial_port_proxy_uri   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.serial_port_service_uri = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.task_poll_interval      = 0.5 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.use_linked_clone        = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.vnc_keymap              = en-us {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.vnc_port                = 5900 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vmware.vnc_port_total          = 10000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.auth_schemes               = ['none'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.enabled                    = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.novncproxy_port            = 6080 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.vencrypt_ca_certs          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.vencrypt_client_cert       = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vnc.vencrypt_client_key        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.disable_rootwrap   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.enable_numa_live_migration = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.libvirt_disable_apic = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.client_socket_timeout     = 900 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.default_pool_size         = 1000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.keep_alive                = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.max_header_line           = 16384 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.ssl_ca_file               = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.ssl_cert_file             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.ssl_key_file              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.tcp_keepidle              = 600 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] zvm.ca_file                    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] zvm.cloud_connector_url        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] zvm.reachable_timeout          = 300 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.enforce_new_defaults = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.enforce_scope      = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.policy_default_rule = default {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.connection_string     = messaging:// {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.enabled               = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.es_doc_type           = notification {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.es_scroll_size        = 10000 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.es_scroll_time        = 2m {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.filter_error_trace    = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.hmac_keys             = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.sentinel_service_name = mymaster {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.socket_timeout        = 0.1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.trace_requests        = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler.trace_sqlalchemy      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler_jaeger.process_tags   = {} {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler_jaeger.service_name_prefix = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] profiler_otlp.service_name_prefix = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] remote_debug.host              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] remote_debug.port              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_notifications.retry = -1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.auth_section        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.auth_type           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.cafile              = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.certfile            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.collect_timing      = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.connect_retries     = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.connect_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.endpoint_id         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.endpoint_override   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.insecure            = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.keyfile             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.max_version         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.min_version         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.region_name         = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.service_name        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.service_type        = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.split_loggers       = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.status_code_retries = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.status_code_retry_delay = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.timeout             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.valid_interfaces    = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_limit.version             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_reports.file_event_handler = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] oslo_reports.log_dir           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.group  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] vif_plug_ovs_privileged.user   = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.isolate_vif         = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] os_brick.lock_path             = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.capabilities   = [21] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.group          = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.helper_command = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] privsep_osbrick.user           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.group           = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.helper_command  = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] nova_sys_admin.user            = None {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG oslo_service.service [None req-ebedbdc5-c96c-4cfb-978a-f093fc675009 None None] ******************************************************************************** {{(pid=72894) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 19:53:23 user nova-compute[72894]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Starting native event thread {{(pid=72894) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Starting green dispatch thread {{(pid=72894) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Starting connection event dispatch thread {{(pid=72894) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Connecting to libvirt: qemu:///system {{(pid=72894) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7999714dc0> {{(pid=72894) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 19:53:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7999714dc0> {{(pid=72894) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 19:53:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Connection event '1' reason 'None'
Aug 16 19:53:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 19:53:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.mount [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Initialising _HostMountState generation 0 {{(pid=72894) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 19:53:30 user nova-compute[72894]: INFO nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host capabilities <capabilities>
Aug 16 19:53:30 user nova-compute[72894]:   <host>
Aug 16 19:53:30 user nova-compute[72894]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 19:53:30 user nova-compute[72894]:     <cpu>
Aug 16 19:53:30 user nova-compute[72894]:       <arch>x86_64</arch>
Aug 16 19:53:30 user nova-compute[72894]:       <model>IvyBridge-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:30 user nova-compute[72894]:       <microcode version='1070'/>
Aug 16 19:53:30 user nova-compute[72894]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 19:53:30 user nova-compute[72894]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='ss'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='vmx'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='pcid'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='osxsave'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='hypervisor'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='arat'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='tsc_adjust'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='md-clear'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='stibp'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='arch-capabilities'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='ssbd'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='invtsc'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='rsba'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 19:53:30 user nova-compute[72894]:       <pages unit='KiB' size='4'/>
Aug 16 19:53:30 user nova-compute[72894]:       <pages unit='KiB' size='2048'/>
Aug 16 19:53:30 user nova-compute[72894]:     </cpu>
Aug 16 19:53:30 user nova-compute[72894]:     <power_management>
Aug 16 19:53:30 user nova-compute[72894]:       <suspend_mem/>
Aug 16 19:53:30 user nova-compute[72894]:       <suspend_disk/>
Aug 16 19:53:30 user nova-compute[72894]:       <suspend_hybrid/>
Aug 16 19:53:30 user nova-compute[72894]:     </power_management>
Aug 16 19:53:30 user nova-compute[72894]:     <iommu support='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     <migration_features>
Aug 16 19:53:30 user nova-compute[72894]:       <live/>
Aug 16 19:53:30 user nova-compute[72894]:       <uri_transports>
Aug 16 19:53:30 user nova-compute[72894]:         <uri_transport>tcp</uri_transport>
Aug 16 19:53:30 user nova-compute[72894]:         <uri_transport>rdma</uri_transport>
Aug 16 19:53:30 user nova-compute[72894]:       </uri_transports>
Aug 16 19:53:30 user nova-compute[72894]:     </migration_features>
Aug 16 19:53:30 user nova-compute[72894]:     <topology>
Aug 16 19:53:30 user nova-compute[72894]:       <cells num='2'>
Aug 16 19:53:30 user nova-compute[72894]:         <cell id='0'>
Aug 16 19:53:30 user nova-compute[72894]:           <memory unit='KiB'>8189224</memory>
Aug 16 19:53:30 user nova-compute[72894]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 16 19:53:30 user nova-compute[72894]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 19:53:30 user nova-compute[72894]:           <distances>
Aug 16 19:53:30 user nova-compute[72894]:             <sibling id='0' value='10'/>
Aug 16 19:53:30 user nova-compute[72894]:             <sibling id='1' value='20'/>
Aug 16 19:53:30 user nova-compute[72894]:           </distances>
Aug 16 19:53:30 user nova-compute[72894]:           <cpus num='6'>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 19:53:30 user nova-compute[72894]:           </cpus>
Aug 16 19:53:30 user nova-compute[72894]:         </cell>
Aug 16 19:53:30 user nova-compute[72894]:         <cell id='1'>
Aug 16 19:53:30 user nova-compute[72894]:           <memory unit='KiB'>8206460</memory>
Aug 16 19:53:30 user nova-compute[72894]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 16 19:53:30 user nova-compute[72894]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 19:53:30 user nova-compute[72894]:           <distances>
Aug 16 19:53:30 user nova-compute[72894]:             <sibling id='0' value='20'/>
Aug 16 19:53:30 user nova-compute[72894]:             <sibling id='1' value='10'/>
Aug 16 19:53:30 user nova-compute[72894]:           </distances>
Aug 16 19:53:30 user nova-compute[72894]:           <cpus num='6'>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 19:53:30 user nova-compute[72894]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 19:53:30 user nova-compute[72894]:           </cpus>
Aug 16 19:53:30 user nova-compute[72894]:         </cell>
Aug 16 19:53:30 user nova-compute[72894]:       </cells>
Aug 16 19:53:30 user nova-compute[72894]:     </topology>
Aug 16 19:53:30 user nova-compute[72894]:     <cache>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 19:53:30 user nova-compute[72894]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 19:53:30 user nova-compute[72894]:     </cache>
Aug 16 19:53:30 user nova-compute[72894]:     <secmodel>
Aug 16 19:53:30 user nova-compute[72894]:       <model>apparmor</model>
Aug 16 19:53:30 user nova-compute[72894]:       <doi>0</doi>
Aug 16 19:53:30 user nova-compute[72894]:     </secmodel>
Aug 16 19:53:30 user nova-compute[72894]:     <secmodel>
Aug 16 19:53:30 user nova-compute[72894]:       <model>dac</model>
Aug 16 19:53:30 user nova-compute[72894]:       <doi>0</doi>
Aug 16 19:53:30 user nova-compute[72894]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 19:53:30 user nova-compute[72894]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 19:53:30 user nova-compute[72894]:     </secmodel>
Aug 16 19:53:30 user nova-compute[72894]:   </host>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='alpha'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>clipper</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='armv6l'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>spitz</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>nuri</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>kzm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>z2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>tosa</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n810</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>terrier</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>midway</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>microbit</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>verdex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>highbank</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>akita</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>connex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>collie</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='armv7l'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>spitz</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>nuri</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>kzm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>z2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>tosa</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n810</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>terrier</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>midway</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>microbit</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>verdex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>highbank</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>akita</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>connex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>collie</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='aarch64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>spitz</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>nuri</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>kzm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>z2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>tosa</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n810</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>n800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>terrier</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>midway</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>microbit</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>verdex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>highbank</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>akita</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>connex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>collie</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <acpi default='on' toggle='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='cris'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='i686'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>isapc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>microvm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='kvm'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <pae/>
Aug 16 19:53:30 user nova-compute[72894]:       <nonpae/>
Aug 16 19:53:30 user nova-compute[72894]:       <acpi default='on' toggle='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:       <apic default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='m68k'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>an5206</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>q800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='microblaze'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='microblazeel'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='mips'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>malta</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='mipsel'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>malta</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='mips64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>malta</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>pica61</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>magnum</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='mips64el'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>malta</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>pica61</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>magnum</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='16'>boston</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='ppc'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mac99</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>40p</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>taihu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='ppc64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>taihu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>40p</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mac99</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='ppc64le'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>taihu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>40p</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>mac99</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='riscv32'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='8'>spike</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='8'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='riscv64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='8'>spike</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='8'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='s390x'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='sh4'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>shix</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>r2d</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='sh4eb'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>shix</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>r2d</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='sparc'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>LX</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='sparc64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>niagara</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='x86_64'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>64</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='1'>isapc</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>microvm</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='kvm'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <acpi default='on' toggle='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:       <apic default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='xtensa'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>sim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>kc705</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ml605</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx200</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx60</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]:   <guest>
Aug 16 19:53:30 user nova-compute[72894]:     <os_type>hvm</os_type>
Aug 16 19:53:30 user nova-compute[72894]:     <arch name='xtensaeb'>
Aug 16 19:53:30 user nova-compute[72894]:       <wordsize>32</wordsize>
Aug 16 19:53:30 user nova-compute[72894]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='4'>sim</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>kc705</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ml605</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>virt</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx200</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>lx60</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 19:53:30 user nova-compute[72894]:       <domain type='qemu'/>
Aug 16 19:53:30 user nova-compute[72894]:     </arch>
Aug 16 19:53:30 user nova-compute[72894]:     <features>
Aug 16 19:53:30 user nova-compute[72894]:       <cpuselection/>
Aug 16 19:53:30 user nova-compute[72894]:       <deviceboot/>
Aug 16 19:53:30 user nova-compute[72894]:       <disksnapshot default='on' toggle='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     </features>
Aug 16 19:53:30 user nova-compute[72894]:   </guest>
Aug 16 19:53:30 user nova-compute[72894]: </capabilities>
Aug 16 19:53:30 user nova-compute[72894]: 
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 19:53:30 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:30 user nova-compute[72894]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 19:53:30 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:30 user nova-compute[72894]:   <machine>pc-i440fx-jammy</machine>
Aug 16 19:53:30 user nova-compute[72894]:   <arch>i686</arch>
Aug 16 19:53:30 user nova-compute[72894]:   <vcpu max='255'/>
Aug 16 19:53:30 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:     <enum name='firmware'/>
Aug 16 19:53:30 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </loader>
Aug 16 19:53:30 user nova-compute[72894]:   </os>
Aug 16 19:53:30 user nova-compute[72894]:   <cpu>
Aug 16 19:53:30 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </mode>
Aug 16 19:53:30 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </mode>
Aug 16 19:53:30 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:30 user nova-compute[72894]:       <feature policy='disable' name='lm'/>
Aug 16 19:53:30 user nova-compute[72894]:     </mode>
Aug 16 19:53:30 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>kvm64</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>core2duo</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Westmere</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Penryn</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Opteron_G1</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Nehalem</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Conroe</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:30 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:30 user nova-compute[72894]:     </mode>
Aug 16 19:53:30 user nova-compute[72894]:   </cpu>
Aug 16 19:53:30 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:30 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:30 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:30 user nova-compute[72894]:     </enum>
Aug 16 19:53:30 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:30 user nova-compute[72894]:   <devices>
Aug 16 19:53:30 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>ide</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </disk>
Aug 16 19:53:30 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </graphics>
Aug 16 19:53:30 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </video>
Aug 16 19:53:30 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:30 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:30 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </rng>
Aug 16 19:53:30 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:30 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:30 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:30 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:30 user nova-compute[72894]:       </enum>
Aug 16 19:53:30 user nova-compute[72894]:     </tpm>
Aug 16 19:53:30 user nova-compute[72894]:   </devices>
Aug 16 19:53:30 user nova-compute[72894]:   <features>
Aug 16 19:53:30 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:30 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:30 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:30 user nova-compute[72894]:   </features>
Aug 16 19:53:30 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:30 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-i440fx-6.2</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>i686</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='255'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'/>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='lm'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ide</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-q35-jammy</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>i686</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='288'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'/>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='lm'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-q35-6.2</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>i686</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='288'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'/>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='lm'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-i440fx-jammy</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>x86_64</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='255'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>efi</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='invtsc'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='rsba'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ide</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-i440fx-6.2</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>x86_64</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='255'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>efi</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='invtsc'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='rsba'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ide</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-q35-jammy</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>x86_64</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='288'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>efi</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='invtsc'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='rsba'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 19:53:31 user nova-compute[72894]: <domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 19:53:31 user nova-compute[72894]:   <domain>kvm</domain>
Aug 16 19:53:31 user nova-compute[72894]:   <machine>pc-q35-6.2</machine>
Aug 16 19:53:31 user nova-compute[72894]:   <arch>x86_64</arch>
Aug 16 19:53:31 user nova-compute[72894]:   <vcpu max='288'/>
Aug 16 19:53:31 user nova-compute[72894]:   <iothreads supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:   <os supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='firmware'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>efi</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:     <loader supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>rom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pflash</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='readonly'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='secure'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>yes</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>no</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </loader>
Aug 16 19:53:31 user nova-compute[72894]:   </os>
Aug 16 19:53:31 user nova-compute[72894]:   <cpu>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-passthrough' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='hostPassthroughMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='maximum' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='maximumMigratable'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>on</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>off</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='host-model' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <vendor>Intel</vendor>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ss'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='vmx'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pcid'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='hypervisor'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arat'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='umip'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='md-clear'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='invtsc'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibpb'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='ibrs'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-stibp'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='rsba'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='erms'/>
Aug 16 19:53:31 user nova-compute[72894]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:     <mode name='custom' supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>qemu64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>qemu32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>phenom</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>pentium</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>n270</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm64</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>kvm32</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>coreduo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>core2duo</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>athlon</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Westmere</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Snowridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Skylake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>SandyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Penryn</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G5</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G4</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G3</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Opteron_G2</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Opteron_G1</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>IvyBridge</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Icelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Haswell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Rome</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-Milan</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>EPYC</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Dhyana</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cooperlake</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>Conroe</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='no'>Broadwell</model>
Aug 16 19:53:31 user nova-compute[72894]:       <model usable='yes'>486</model>
Aug 16 19:53:31 user nova-compute[72894]:     </mode>
Aug 16 19:53:31 user nova-compute[72894]:   </cpu>
Aug 16 19:53:31 user nova-compute[72894]:   <memoryBacking supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:     <enum name='sourceType'>
Aug 16 19:53:31 user nova-compute[72894]:       <value>file</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>anonymous</value>
Aug 16 19:53:31 user nova-compute[72894]:       <value>memfd</value>
Aug 16 19:53:31 user nova-compute[72894]:     </enum>
Aug 16 19:53:31 user nova-compute[72894]:   </memoryBacking>
Aug 16 19:53:31 user nova-compute[72894]:   <devices>
Aug 16 19:53:31 user nova-compute[72894]:     <disk supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='diskDevice'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>disk</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cdrom</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>floppy</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>lun</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='bus'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>fdc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sata</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </disk>
Aug 16 19:53:31 user nova-compute[72894]:     <graphics supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='type'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>sdl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vnc</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>spice</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egl-headless</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </graphics>
Aug 16 19:53:31 user nova-compute[72894]:     <video supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='modelType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>cirrus</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>vmvga</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>qxl</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>none</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>bochs</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>ramfb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </video>
Aug 16 19:53:31 user nova-compute[72894]:     <hostdev supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='mode'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>subsystem</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='startupPolicy'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>default</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>mandatory</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>requisite</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>optional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='subsysType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>usb</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>pci</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>scsi</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='capsType'/>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='pciBackend'/>
Aug 16 19:53:31 user nova-compute[72894]:     </hostdev>
Aug 16 19:53:31 user nova-compute[72894]:     <rng supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtio-non-transitional</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>random</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>egd</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>builtin</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </rng>
Aug 16 19:53:31 user nova-compute[72894]:     <filesystem supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='driverType'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>path</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>handle</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>virtiofs</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </filesystem>
Aug 16 19:53:31 user nova-compute[72894]:     <tpm supported='yes'>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='model'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-tis</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>tpm-crb</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:       <enum name='backendModel'>
Aug 16 19:53:31 user nova-compute[72894]:         <value>passthrough</value>
Aug 16 19:53:31 user nova-compute[72894]:         <value>emulator</value>
Aug 16 19:53:31 user nova-compute[72894]:       </enum>
Aug 16 19:53:31 user nova-compute[72894]:     </tpm>
Aug 16 19:53:31 user nova-compute[72894]:   </devices>
Aug 16 19:53:31 user nova-compute[72894]:   <features>
Aug 16 19:53:31 user nova-compute[72894]:     <gic supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:     <vmcoreinfo supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <genid supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backingStoreInput supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <backup supported='yes'/>
Aug 16 19:53:31 user nova-compute[72894]:     <sev supported='no'/>
Aug 16 19:53:31 user nova-compute[72894]:   </features>
Aug 16 19:53:31 user nova-compute[72894]: </domainCapabilities>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72894) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72894) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72894) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72894) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72894) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72894) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72894) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 19:53:31 user nova-compute[72894]: INFO nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Secure Boot support detected
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] cpu compare xml: <cpu match="exact">
Aug 16 19:53:31 user nova-compute[72894]:   <model>Nehalem</model>
Aug 16 19:53:31 user nova-compute[72894]: </cpu>
Aug 16 19:53:31 user nova-compute[72894]:  {{(pid=72894) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 19:53:31 user nova-compute[72894]: INFO nova.virt.node [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Generated node identity 3aeddb5a-5151-4ab0-bd05-66d638b30977
Aug 16 19:53:31 user nova-compute[72894]: INFO nova.virt.node [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Wrote node identity 3aeddb5a-5151-4ab0-bd05-66d638b30977 to /opt/stack/data/nova/compute_id
Aug 16 19:53:31 user nova-compute[72894]: WARNING nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Compute nodes ['3aeddb5a-5151-4ab0-bd05-66d638b30977'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 19:53:31 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 19:53:31 user nova-compute[72894]: WARNING nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 19:53:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:53:31 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:53:31 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Hypervisor/Node resource view: name=user free_ram=10819MB free_disk=25.30880355834961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:53:31 user nova-compute[72894]: WARNING nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] No compute node record for user:3aeddb5a-5151-4ab0-bd05-66d638b30977: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3aeddb5a-5151-4ab0-bd05-66d638b30977 could not be found.
Aug 16 19:53:31 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Compute node record created for user:user with uuid: 3aeddb5a-5151-4ab0-bd05-66d638b30977
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:53:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:53:32 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [req-af378fb4-d881-4a3e-9cac-b22be95c3902] Created resource provider record via placement API for resource provider with UUID 3aeddb5a-5151-4ab0-bd05-66d638b30977 and name user.
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72894) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 19:53:32 user nova-compute[72894]: INFO nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] kernel doesn't support AMD SEV
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Libvirt baseline CPU <cpu>
Aug 16 19:53:32 user nova-compute[72894]:   <arch>x86_64</arch>
Aug 16 19:53:32 user nova-compute[72894]:   <model>Nehalem</model>
Aug 16 19:53:32 user nova-compute[72894]:   <vendor>Intel</vendor>
Aug 16 19:53:32 user nova-compute[72894]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 19:53:32 user nova-compute[72894]: </cpu>
Aug 16 19:53:32 user nova-compute[72894]:  {{(pid=72894) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Updated inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Updating resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 generation from 0 to 1 during operation: update_inventory {{(pid=72894) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Updating resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 generation from 1 to 2 during operation: update_traits {{(pid=72894) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.service [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Creating RPC server for service compute {{(pid=72894) start /opt/stack/nova/nova/service.py:182}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.service [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Join ServiceGroup membership for this service compute {{(pid=72894) start /opt/stack/nova/nova/service.py:199}}
Aug 16 19:53:32 user nova-compute[72894]: DEBUG nova.servicegroup.drivers.db [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72894) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 19:53:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:53:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:54:23 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:54:23 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=25.212448120117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:54:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:55:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:55:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:55:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=10143MB free_disk=25.25857925415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.097s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:55:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:55:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:56:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:56:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=10132MB free_disk=25.042808532714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:56:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:56:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:56:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:57:26 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:26 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=9396MB free_disk=25.064838409423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:57:26 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:57:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:57:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:57:29 user nova-compute[72894]: INFO nova.compute.claims [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Claim successful on node user
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:57:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:57:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:57:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Creating image(s)
Aug 16 19:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG nova.policy [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c9bdeca6ea84622835b26c7565f148c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0853a75dd30c499288bb5e848f038580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.part --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG nova.virt.images [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] 60545238-42c7-459f-80c0-4238accb7183 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:57:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.part /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.part /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.converted" returned: 0 in 0.524s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.124s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:32 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8dbuu2mq/privsep.sock']
Aug 16 19:57:32 user sudo[82339]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8dbuu2mq/privsep.sock
Aug 16 19:57:32 user sudo[82339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 19:57:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Successfully created port: a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:57:34 user sudo[82339]: pam_unix(sudo:session): session closed for user root
Aug 16 19:57:34 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Spawned new privsep daemon via rootwrap
Aug 16 19:57:34 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 19:57:34 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 19:57:34 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 19:57:34 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82344
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk 1073741824" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:57:35 user nova-compute[72894]: INFO nova.compute.claims [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Claim successful on node user
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Cannot resize image /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'migration_context' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Ensure instance console log exists: /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.056s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:57:35 user nova-compute[72894]: INFO nova.compute.claims [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Claim successful on node user
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:57:35 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:57:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.policy [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82f6efbf71343eca3f5b09517d3a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a2a663816647aa9bb26ac44848f40e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:57:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Creating image(s)
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:57:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:57:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Creating image(s)
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Successfully updated port: a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk 1073741824" returned: 0 in 0.061s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.policy [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6787ebe74f6445caa43d44813f58ab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d388dc7ba4643d198d2999ec1f87afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.238s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk 1073741824" returned: 0 in 0.051s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-changed-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Refreshing instance network info cache due to event network-changed-a0e1238f-ce15-4409-a4da-940ad77f4f75. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Cannot resize image /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'migration_context' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Ensure instance console log exists: /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Cannot resize image /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'migration_context' on Instance uuid f3d00d19-bfc7-4b98-b468-7d06526e6124 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Ensure instance console log exists: /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:37 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Successfully created port: 2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Instance network_info: |[{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.neutron [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Refreshing network info cache for port a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Start _get_guest_xml network_info=[{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:57:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063472027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063472027',id=1,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-79ivzmle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:30Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=5ac6a4fb-e267-4273-930d-54f6b20e1d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:57:38 user nova-compute[72894]:   <uuid>5ac6a4fb-e267-4273-930d-54f6b20e1d03</uuid>
Aug 16 19:57:38 user nova-compute[72894]:   <name>instance-00000001</name>
Aug 16 19:57:38 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:57:38 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:57:38 user nova-compute[72894]:   <metadata>
Aug 16 19:57:38 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:57:38 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2063472027</nova:name>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:57:38</nova:creationTime>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:57:38 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:57:38 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:owner>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 19:57:38 user nova-compute[72894]:       </nova:owner>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:57:38 user nova-compute[72894]:       <nova:ports>
Aug 16 19:57:38 user nova-compute[72894]:         <nova:port uuid="a0e1238f-ce15-4409-a4da-940ad77f4f75">
Aug 16 19:57:38 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 19:57:38 user nova-compute[72894]:         </nova:port>
Aug 16 19:57:38 user nova-compute[72894]:       </nova:ports>
Aug 16 19:57:38 user nova-compute[72894]:     </nova:instance>
Aug 16 19:57:38 user nova-compute[72894]:   </metadata>
Aug 16 19:57:38 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:57:38 user nova-compute[72894]:     <system>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="serial">5ac6a4fb-e267-4273-930d-54f6b20e1d03</entry>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="uuid">5ac6a4fb-e267-4273-930d-54f6b20e1d03</entry>
Aug 16 19:57:38 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:57:38 user nova-compute[72894]:     </system>
Aug 16 19:57:38 user nova-compute[72894]:   </sysinfo>
Aug 16 19:57:38 user nova-compute[72894]:   <os>
Aug 16 19:57:38 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:57:38 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:57:38 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:57:38 user nova-compute[72894]:   </os>
Aug 16 19:57:38 user nova-compute[72894]:   <features>
Aug 16 19:57:38 user nova-compute[72894]:     <acpi/>
Aug 16 19:57:38 user nova-compute[72894]:     <apic/>
Aug 16 19:57:38 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:57:38 user nova-compute[72894]:   </features>
Aug 16 19:57:38 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:57:38 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:57:38 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:57:38 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:57:38 user nova-compute[72894]:   </clock>
Aug 16 19:57:38 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:57:38 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:57:38 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:57:38 user nova-compute[72894]:   </cpu>
Aug 16 19:57:38 user nova-compute[72894]:   <devices>
Aug 16 19:57:38 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:57:38 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:57:38 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk"/>
Aug 16 19:57:38 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:57:38 user nova-compute[72894]:     </disk>
Aug 16 19:57:38 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:57:38 user nova-compute[72894]:       <mac address="fa:16:3e:c3:bc:5e"/>
Aug 16 19:57:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:38 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:57:38 user nova-compute[72894]:       <target dev="tapa0e1238f-ce"/>
Aug 16 19:57:38 user nova-compute[72894]:     </interface>
Aug 16 19:57:38 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:57:38 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/console.log" append="off"/>
Aug 16 19:57:38 user nova-compute[72894]:     </serial>
Aug 16 19:57:38 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:57:38 user nova-compute[72894]:     <video>
Aug 16 19:57:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:38 user nova-compute[72894]:     </video>
Aug 16 19:57:38 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:57:38 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:57:38 user nova-compute[72894]:     </rng>
Aug 16 19:57:38 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:57:38 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:57:38 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:57:38 user nova-compute[72894]:     </memballoon>
Aug 16 19:57:38 user nova-compute[72894]:   </devices>
Aug 16 19:57:38 user nova-compute[72894]: </domain>
Aug 16 19:57:38 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063472027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063472027',id=1,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-79ivzmle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:30Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=5ac6a4fb-e267-4273-930d-54f6b20e1d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG os_vif [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Created schema index Interface.name {{(pid=72894) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Created schema index Port.name {{(pid=72894) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Created schema index Bridge.name {{(pid=72894) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [POLLOUT] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:57:38 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpzmg908ec/privsep.sock']
Aug 16 19:57:38 user sudo[82482]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpzmg908ec/privsep.sock
Aug 16 19:57:38 user sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 19:57:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Successfully created port: f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:57:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updated VIF entry in instance network info cache for port a0e1238f-ce15-4409-a4da-940ad77f4f75. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:57:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-25393655-b9b9-4621-b839-38d1f1dec8d1 req-7ca17ffe-d1e7-4208-921a-cf7ae9af9d0b service nova] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Successfully updated port: f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:57:40 user sudo[82482]: pam_unix(sudo:session): session closed for user root
Aug 16 19:57:40 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Spawned new privsep daemon via rootwrap
Aug 16 19:57:40 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 19:57:40 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 19:57:40 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 19:57:40 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82490
Aug 16 19:57:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Successfully updated port: 2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing instance network info cache due to event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e1238f-ce, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0e1238f-ce, col_values=(('external_ids', {'iface-id': 'a0e1238f-ce15-4409-a4da-940ad77f4f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:bc:5e', 'vm-uuid': '5ac6a4fb-e267-4273-930d-54f6b20e1d03'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: INFO os_vif [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce')
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:c3:bc:5e, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-changed-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Refreshing instance network info cache due to event network-changed-2ea3d08c-315a-4008-917c-b629398a8b98. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Instance network_info: |[{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Start _get_guest_xml network_info=[{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:57:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-883206817',display_name='tempest-ServerActionsTestOtherA-server-883206817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-883206817',id=3,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-42z2wbo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=f3d00d19-bfc7-4b98-b468-7d06526e6124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_devices' on Instance uuid f3d00d19-bfc7-4b98-b468-7d06526e6124 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:57:41 user nova-compute[72894]:   <uuid>f3d00d19-bfc7-4b98-b468-7d06526e6124</uuid>
Aug 16 19:57:41 user nova-compute[72894]:   <name>instance-00000003</name>
Aug 16 19:57:41 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:57:41 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:57:41 user nova-compute[72894]:   <metadata>
Aug 16 19:57:41 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:57:41 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherA-server-883206817</nova:name>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:57:41</nova:creationTime>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:57:41 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:57:41 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:owner>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:user uuid="6787ebe74f6445caa43d44813f58ab21">tempest-ServerActionsTestOtherA-2019589976-project-member</nova:user>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:project uuid="0d388dc7ba4643d198d2999ec1f87afe">tempest-ServerActionsTestOtherA-2019589976</nova:project>
Aug 16 19:57:41 user nova-compute[72894]:       </nova:owner>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:57:41 user nova-compute[72894]:       <nova:ports>
Aug 16 19:57:41 user nova-compute[72894]:         <nova:port uuid="f3449faa-4fc8-45a8-ab01-92e456d1eda7">
Aug 16 19:57:41 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 19:57:41 user nova-compute[72894]:         </nova:port>
Aug 16 19:57:41 user nova-compute[72894]:       </nova:ports>
Aug 16 19:57:41 user nova-compute[72894]:     </nova:instance>
Aug 16 19:57:41 user nova-compute[72894]:   </metadata>
Aug 16 19:57:41 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:57:41 user nova-compute[72894]:     <system>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="serial">f3d00d19-bfc7-4b98-b468-7d06526e6124</entry>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="uuid">f3d00d19-bfc7-4b98-b468-7d06526e6124</entry>
Aug 16 19:57:41 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:57:41 user nova-compute[72894]:     </system>
Aug 16 19:57:41 user nova-compute[72894]:   </sysinfo>
Aug 16 19:57:41 user nova-compute[72894]:   <os>
Aug 16 19:57:41 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:57:41 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:57:41 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:57:41 user nova-compute[72894]:   </os>
Aug 16 19:57:41 user nova-compute[72894]:   <features>
Aug 16 19:57:41 user nova-compute[72894]:     <acpi/>
Aug 16 19:57:41 user nova-compute[72894]:     <apic/>
Aug 16 19:57:41 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:57:41 user nova-compute[72894]:   </features>
Aug 16 19:57:41 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:57:41 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:57:41 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:57:41 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:57:41 user nova-compute[72894]:   </clock>
Aug 16 19:57:41 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:57:41 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:57:41 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:57:41 user nova-compute[72894]:   </cpu>
Aug 16 19:57:41 user nova-compute[72894]:   <devices>
Aug 16 19:57:41 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:57:41 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:57:41 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk"/>
Aug 16 19:57:41 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:57:41 user nova-compute[72894]:     </disk>
Aug 16 19:57:41 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:57:41 user nova-compute[72894]:       <mac address="fa:16:3e:1f:49:b5"/>
Aug 16 19:57:41 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:41 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:57:41 user nova-compute[72894]:       <target dev="tapf3449faa-4f"/>
Aug 16 19:57:41 user nova-compute[72894]:     </interface>
Aug 16 19:57:41 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:57:41 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/console.log" append="off"/>
Aug 16 19:57:41 user nova-compute[72894]:     </serial>
Aug 16 19:57:41 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:57:41 user nova-compute[72894]:     <video>
Aug 16 19:57:41 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:41 user nova-compute[72894]:     </video>
Aug 16 19:57:41 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:57:41 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:57:41 user nova-compute[72894]:     </rng>
Aug 16 19:57:41 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:57:41 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:57:41 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:57:41 user nova-compute[72894]:     </memballoon>
Aug 16 19:57:41 user nova-compute[72894]:   </devices>
Aug 16 19:57:41 user nova-compute[72894]: </domain>
Aug 16 19:57:41 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-883206817',display_name='tempest-ServerActionsTestOtherA-server-883206817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-883206817',id=3,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-42z2wbo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=f3d00d19-bfc7-4b98-b468-7d06526e6124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG os_vif [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3449faa-4f, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3449faa-4f, col_values=(('external_ids', {'iface-id': 'f3449faa-4fc8-45a8-ab01-92e456d1eda7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:49:b5', 'vm-uuid': 'f3d00d19-bfc7-4b98-b468-7d06526e6124'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: INFO os_vif [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f')
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:1f:49:b5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance network_info: |[{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Refreshing network info cache for port 2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start _get_guest_xml network_info=[{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:57:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'pci_devices' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:57:42 user nova-compute[72894]:   <uuid>12dd204d-9368-47c2-88e2-8d97ff942621</uuid>
Aug 16 19:57:42 user nova-compute[72894]:   <name>instance-00000002</name>
Aug 16 19:57:42 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:57:42 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:57:42 user nova-compute[72894]:   <metadata>
Aug 16 19:57:42 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:57:42 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherB-server-1557906681</nova:name>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:57:42</nova:creationTime>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:57:42 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:57:42 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:owner>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:user uuid="a82f6efbf71343eca3f5b09517d3a86d">tempest-ServerActionsTestOtherB-85778765-project-member</nova:user>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:project uuid="71a2a663816647aa9bb26ac44848f40e">tempest-ServerActionsTestOtherB-85778765</nova:project>
Aug 16 19:57:42 user nova-compute[72894]:       </nova:owner>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:57:42 user nova-compute[72894]:       <nova:ports>
Aug 16 19:57:42 user nova-compute[72894]:         <nova:port uuid="2ea3d08c-315a-4008-917c-b629398a8b98">
Aug 16 19:57:42 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 19:57:42 user nova-compute[72894]:         </nova:port>
Aug 16 19:57:42 user nova-compute[72894]:       </nova:ports>
Aug 16 19:57:42 user nova-compute[72894]:     </nova:instance>
Aug 16 19:57:42 user nova-compute[72894]:   </metadata>
Aug 16 19:57:42 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:57:42 user nova-compute[72894]:     <system>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="serial">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="uuid">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 19:57:42 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:57:42 user nova-compute[72894]:     </system>
Aug 16 19:57:42 user nova-compute[72894]:   </sysinfo>
Aug 16 19:57:42 user nova-compute[72894]:   <os>
Aug 16 19:57:42 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:57:42 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:57:42 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:57:42 user nova-compute[72894]:   </os>
Aug 16 19:57:42 user nova-compute[72894]:   <features>
Aug 16 19:57:42 user nova-compute[72894]:     <acpi/>
Aug 16 19:57:42 user nova-compute[72894]:     <apic/>
Aug 16 19:57:42 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:57:42 user nova-compute[72894]:   </features>
Aug 16 19:57:42 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:57:42 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:57:42 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:57:42 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:57:42 user nova-compute[72894]:   </clock>
Aug 16 19:57:42 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:57:42 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:57:42 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:57:42 user nova-compute[72894]:   </cpu>
Aug 16 19:57:42 user nova-compute[72894]:   <devices>
Aug 16 19:57:42 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:57:42 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:57:42 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk"/>
Aug 16 19:57:42 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:57:42 user nova-compute[72894]:     </disk>
Aug 16 19:57:42 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:57:42 user nova-compute[72894]:       <mac address="fa:16:3e:30:37:0b"/>
Aug 16 19:57:42 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:42 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:57:42 user nova-compute[72894]:       <target dev="tap2ea3d08c-31"/>
Aug 16 19:57:42 user nova-compute[72894]:     </interface>
Aug 16 19:57:42 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:57:42 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/console.log" append="off"/>
Aug 16 19:57:42 user nova-compute[72894]:     </serial>
Aug 16 19:57:42 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:57:42 user nova-compute[72894]:     <video>
Aug 16 19:57:42 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:57:42 user nova-compute[72894]:     </video>
Aug 16 19:57:42 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:57:42 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:57:42 user nova-compute[72894]:     </rng>
Aug 16 19:57:42 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:57:42 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:57:42 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:57:42 user nova-compute[72894]:     </memballoon>
Aug 16 19:57:42 user nova-compute[72894]:   </devices>
Aug 16 19:57:42 user nova-compute[72894]: </domain>
Aug 16 19:57:42 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG os_vif [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea3d08c-31, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ea3d08c-31, col_values=(('external_ids', {'iface-id': '2ea3d08c-315a-4008-917c-b629398a8b98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:37:0b', 'vm-uuid': '12dd204d-9368-47c2-88e2-8d97ff942621'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:42 user nova-compute[72894]: INFO os_vif [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated VIF entry in instance network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No VIF found with MAC fa:16:3e:30:37:0b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:57:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-700bb277-2a87-4c2c-a5ed-bf8c14132a3c req-f5d24a00-52ee-43ce-9abd-1cd397d62960 service nova] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:43 user nova-compute[72894]: DEBUG nova.network.neutron [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updated VIF entry in instance network info cache for port 2ea3d08c-315a-4008-917c-b629398a8b98. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:57:43 user nova-compute[72894]: DEBUG nova.network.neutron [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:57:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe9b3e89-a30a-4e41-84e9-b690126c3f4c req-d5aefd94-b76c-42f8-83f7-bbf60a088ddd service nova] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:57:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.39725, 5ac6a4fb-e267-4273-930d-54f6b20e1d03 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] VM Resumed (Lifecycle Event)
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Instance spawned successfully.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.4116154, 5ac6a4fb-e267-4273-930d-54f6b20e1d03 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] VM Started (Lifecycle Event)
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Took 18.48 seconds to spawn the instance on the hypervisor.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.717968, f3d00d19-bfc7-4b98-b468-7d06526e6124 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] VM Resumed (Lifecycle Event)
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Instance spawned successfully.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.7207174, f3d00d19-bfc7-4b98-b468-7d06526e6124 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] VM Started (Lifecycle Event)
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Took 19.52 seconds to build instance.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2bdedbdf-911c-4ec1-baca-aae920a4f1f6 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.802s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance spawned successfully.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:57:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.8443322, 12dd204d-9368-47c2-88e2-8d97ff942621 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Resumed (Lifecycle Event)
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Took 12.80 seconds to spawn the instance on the hypervisor.
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] No waiting events found dispatching network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:57:49 user nova-compute[72894]: WARNING nova.compute.manager [req-5ebc2224-34ec-4270-a7ce-813afdad3dee req-57dcb6ae-611a-49db-a130-483894ba1584 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received unexpected event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 for instance with vm_state active and task_state None.
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Took 13.21 seconds to spawn the instance on the hypervisor.
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215868.8525732, 12dd204d-9368-47c2-88e2-8d97ff942621 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Started (Lifecycle Event)
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Took 14.13 seconds to build instance.
Aug 16 19:57:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Took 14.50 seconds to build instance.
Aug 16 19:57:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da2-342e-4655-9bec-8be3ccb058b3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.358s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd92da2c-4655-4c43-b20c-d8429a24b57f tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.679s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] No waiting events found dispatching network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:57:51 user nova-compute[72894]: WARNING nova.compute.manager [req-515ff84a-1aaf-4acc-a7d8-5aba20695372 req-eb5181cd-b228-4c8d-bd25-5573c319031d service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received unexpected event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 for instance with vm_state active and task_state None.
Aug 16 19:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] No waiting events found dispatching network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:57:53 user nova-compute[72894]: WARNING nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received unexpected event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 for instance with vm_state active and task_state None.
Aug 16 19:57:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] No waiting events found dispatching network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:57:53 user nova-compute[72894]: WARNING nova.compute.manager [req-9e713954-11b0-47ba-8d40-f496f8734159 req-114ebb82-929f-4e0d-80ba-23ba8a72401a service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received unexpected event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 for instance with vm_state active and task_state None.
Aug 16 19:57:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:57:56 user nova-compute[72894]: INFO nova.compute.claims [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Claim successful on node user
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:57:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.policy [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5af7e3dd3bc84d2a9d9ad6476d3c441a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3725e09c11846bf9d7973fc87d1134a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:57:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Creating image(s)
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "3653805e5e61791e116eefa28b20428434da992a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "3653805e5e61791e116eefa28b20428434da992a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.part --force-share --output=json" returned: 0 in 0.257s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG nova.virt.images [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] be1c9a63-6264-4b0e-8d7b-913a1a36f1b3 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.part /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Successfully created port: 642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.part /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.converted" returned: 0 in 0.397s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "3653805e5e61791e116eefa28b20428434da992a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.550s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json" returned: 0 in 0.223s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "3653805e5e61791e116eefa28b20428434da992a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "3653805e5e61791e116eefa28b20428434da992a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a,backing_fmt=raw /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a,backing_fmt=raw /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk 1073741824" returned: 0 in 0.082s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "3653805e5e61791e116eefa28b20428434da992a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Successfully updated port: 642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquired lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-changed-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Refreshing instance network info cache due to event network-changed-642f6751-1a5e-4b1e-bd3b-b96a0911456d. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] Acquiring lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a --force-share --output=json" returned: 0 in 0.270s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Cannot resize image /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'migration_context' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Ensure instance console log exists: /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating instance_info_cache with network_info: [{"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Releasing lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Instance network_info: |[{"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] Acquired lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Refreshing network info cache for port 642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Start _get_guest_xml network_info=[{"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:57:46Z,direct_url=<?>,disk_format='qcow2',id=be1c9a63-6264-4b0e-8d7b-913a1a36f1b3,min_disk=0,min_ram=0,name='',owner='e1fb2ec293714009823bf134dfda7690',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:57:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'scsi', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'be1c9a63-6264-4b0e-8d7b-913a1a36f1b3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:58:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:57:46Z,direct_url=<?>,disk_format='qcow2',id=be1c9a63-6264-4b0e-8d7b-913a1a36f1b3,min_disk=0,min_ram=0,name='',owner='e1fb2ec293714009823bf134dfda7690',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:57:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-710866739',display_name='tempest-AttachSCSIVolumeTestJSON-server-710866739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-710866739',id=4,image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3OtQWKctR9iUAn1y6HNvoQE/Zs3V5z65DiqUN0wANEbFylM4lrHy8gE2lKbX/jG44dKfDUBcbL/l/GA2gn5zhXAU0u0p9llUc7nr9mWSH1zqD1h1afcZdm8ICq6IfpJw==',key_name='tempest-keypair-1795052867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3725e09c11846bf9d7973fc87d1134a',ramdisk_id='',reservation_id='r-egemkt9q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1462863841',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1462863841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af7e3dd3bc84d2a9d9ad6476d3c441a',uuid=91a5c13b-ef0e-4423-a0d4-d1dce8eb091b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converting VIF {"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'pci_devices' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:58:00 user nova-compute[72894]:   <uuid>91a5c13b-ef0e-4423-a0d4-d1dce8eb091b</uuid>
Aug 16 19:58:00 user nova-compute[72894]:   <name>instance-00000004</name>
Aug 16 19:58:00 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:58:00 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:58:00 user nova-compute[72894]:   <metadata>
Aug 16 19:58:00 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:58:00 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-710866739</nova:name>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:58:00</nova:creationTime>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:58:00 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:58:00 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:owner>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:user uuid="5af7e3dd3bc84d2a9d9ad6476d3c441a">tempest-AttachSCSIVolumeTestJSON-1462863841-project-member</nova:user>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:project uuid="e3725e09c11846bf9d7973fc87d1134a">tempest-AttachSCSIVolumeTestJSON-1462863841</nova:project>
Aug 16 19:58:00 user nova-compute[72894]:       </nova:owner>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:root type="image" uuid="be1c9a63-6264-4b0e-8d7b-913a1a36f1b3"/>
Aug 16 19:58:00 user nova-compute[72894]:       <nova:ports>
Aug 16 19:58:00 user nova-compute[72894]:         <nova:port uuid="642f6751-1a5e-4b1e-bd3b-b96a0911456d">
Aug 16 19:58:00 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 19:58:00 user nova-compute[72894]:         </nova:port>
Aug 16 19:58:00 user nova-compute[72894]:       </nova:ports>
Aug 16 19:58:00 user nova-compute[72894]:     </nova:instance>
Aug 16 19:58:00 user nova-compute[72894]:   </metadata>
Aug 16 19:58:00 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:58:00 user nova-compute[72894]:     <system>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="serial">91a5c13b-ef0e-4423-a0d4-d1dce8eb091b</entry>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="uuid">91a5c13b-ef0e-4423-a0d4-d1dce8eb091b</entry>
Aug 16 19:58:00 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:58:00 user nova-compute[72894]:     </system>
Aug 16 19:58:00 user nova-compute[72894]:   </sysinfo>
Aug 16 19:58:00 user nova-compute[72894]:   <os>
Aug 16 19:58:00 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:58:00 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:58:00 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:58:00 user nova-compute[72894]:   </os>
Aug 16 19:58:00 user nova-compute[72894]:   <features>
Aug 16 19:58:00 user nova-compute[72894]:     <acpi/>
Aug 16 19:58:00 user nova-compute[72894]:     <apic/>
Aug 16 19:58:00 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:58:00 user nova-compute[72894]:   </features>
Aug 16 19:58:00 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:58:00 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:58:00 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:58:00 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:58:00 user nova-compute[72894]:   </clock>
Aug 16 19:58:00 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:58:00 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:58:00 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:58:00 user nova-compute[72894]:   </cpu>
Aug 16 19:58:00 user nova-compute[72894]:   <devices>
Aug 16 19:58:00 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:58:00 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:58:00 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk"/>
Aug 16 19:58:00 user nova-compute[72894]:       <target dev="sda" bus="scsi"/>
Aug 16 19:58:00 user nova-compute[72894]:       <address type="drive" controller="0" unit="0"/>
Aug 16 19:58:00 user nova-compute[72894]:     </disk>
Aug 16 19:58:00 user nova-compute[72894]:     <disk type="file" device="cdrom">
Aug 16 19:58:00 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 19:58:00 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.config"/>
Aug 16 19:58:00 user nova-compute[72894]:       <target dev="sdb" bus="scsi"/>
Aug 16 19:58:00 user nova-compute[72894]:       <address type="drive" controller="0" unit="1"/>
Aug 16 19:58:00 user nova-compute[72894]:     </disk>
Aug 16 19:58:00 user nova-compute[72894]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 19:58:00 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:58:00 user nova-compute[72894]:       <mac address="fa:16:3e:03:77:fe"/>
Aug 16 19:58:00 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:00 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:58:00 user nova-compute[72894]:       <target dev="tap642f6751-1a"/>
Aug 16 19:58:00 user nova-compute[72894]:     </interface>
Aug 16 19:58:00 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:58:00 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/console.log" append="off"/>
Aug 16 19:58:00 user nova-compute[72894]:     </serial>
Aug 16 19:58:00 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:58:00 user nova-compute[72894]:     <video>
Aug 16 19:58:00 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:00 user nova-compute[72894]:     </video>
Aug 16 19:58:00 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:58:00 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:58:00 user nova-compute[72894]:     </rng>
Aug 16 19:58:00 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:58:00 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:58:00 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:58:00 user nova-compute[72894]:     </memballoon>
Aug 16 19:58:00 user nova-compute[72894]:   </devices>
Aug 16 19:58:00 user nova-compute[72894]: </domain>
Aug 16 19:58:00 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-710866739',display_name='tempest-AttachSCSIVolumeTestJSON-server-710866739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-710866739',id=4,image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3OtQWKctR9iUAn1y6HNvoQE/Zs3V5z65DiqUN0wANEbFylM4lrHy8gE2lKbX/jG44dKfDUBcbL/l/GA2gn5zhXAU0u0p9llUc7nr9mWSH1zqD1h1afcZdm8ICq6IfpJw==',key_name='tempest-keypair-1795052867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3725e09c11846bf9d7973fc87d1134a',ramdisk_id='',reservation_id='r-egemkt9q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1462863841',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1462863841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af7e3dd3bc84d2a9d9ad6476d3c441a',uuid=91a5c13b-ef0e-4423-a0d4-d1dce8eb091b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converting VIF {"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG os_vif [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap642f6751-1a, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap642f6751-1a, col_values=(('external_ids', {'iface-id': '642f6751-1a5e-4b1e-bd3b-b96a0911456d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:77:fe', 'vm-uuid': '91a5c13b-ef0e-4423-a0d4-d1dce8eb091b'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:00 user nova-compute[72894]: INFO os_vif [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a')
Aug 16 19:58:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No BDM found with device name sda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:58:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:58:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No VIF found with MAC fa:16:3e:03:77:fe, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:58:01 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Using config drive
Aug 16 19:58:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updated VIF entry in instance network info cache for port 642f6751-1a5e-4b1e-bd3b-b96a0911456d. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:58:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating instance_info_cache with network_info: [{"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:01 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Creating config drive at /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.config
Aug 16 19:58:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl1er6roa {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e8ec67e-f5a8-4303-b841-e71490488b37 req-1bd36fe4-65a9-427a-9544-c00295ad6324 service nova] Releasing lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl1er6roa" returned: 0 in 0.084s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:02 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:58:02 user nova-compute[72894]: INFO nova.compute.claims [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Claim successful on node user
Aug 16 19:58:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:58:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.policy [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '209ab74834804fa3b563882443745016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ff567df974b26915a694ecef12434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:58:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Creating image(s)
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "/opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "/opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "/opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.248s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk 1073741824" returned: 0 in 0.065s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.268s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Successfully created port: 63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Cannot resize image /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lazy-loading 'migration_context' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Ensure instance console log exists: /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Successfully updated port: 63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquired lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-changed-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Refreshing instance network info cache due to event network-changed-63efa10d-cb37-4eaf-a1f4-0032c4f34cda. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] Acquiring lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updating instance_info_cache with network_info: [{"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215886.039923, 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] VM Resumed (Lifecycle Event)
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Instance spawned successfully.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Releasing lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Instance network_info: |[{"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] Acquired lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Refreshing network info cache for port 63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Start _get_guest_xml network_info=[{"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:06 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:06 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215886.0471654, 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] VM Started (Lifecycle Event)
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1082279093',display_name='tempest-VolumesAssistedSnapshotsTest-server-1082279093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1082279093',id=5,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaW7bHo8ffed3n0hTz0IWiacz4bz1UJYwvP5zM/60aEoiE+tnp67mCnKGFzYgXBwun9xk5TAdbDzfYCk/kxDCK+vEXCKrJ3FokYruHlVeq3rnoUFnr0dCRf0NITvpVDQ==',key_name='tempest-keypair-667819731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='317ff567df974b26915a694ecef12434',ramdisk_id='',reservation_id='r-9emt5gf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-140938868',owner_user_name='tempest-VolumesAssistedSnapshotsTest-140938868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209ab74834804fa3b563882443745016',uuid=8221cae3-a185-4cff-bbb3-f20cf08e369b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converting VIF {"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lazy-loading 'pci_devices' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Took 8.35 seconds to spawn the instance on the hypervisor.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:58:06 user nova-compute[72894]:   <uuid>8221cae3-a185-4cff-bbb3-f20cf08e369b</uuid>
Aug 16 19:58:06 user nova-compute[72894]:   <name>instance-00000005</name>
Aug 16 19:58:06 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:58:06 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:58:06 user nova-compute[72894]:   <metadata>
Aug 16 19:58:06 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:58:06 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1082279093</nova:name>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:58:06</nova:creationTime>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:58:06 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:58:06 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:owner>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:user uuid="209ab74834804fa3b563882443745016">tempest-VolumesAssistedSnapshotsTest-140938868-project-member</nova:user>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:project uuid="317ff567df974b26915a694ecef12434">tempest-VolumesAssistedSnapshotsTest-140938868</nova:project>
Aug 16 19:58:06 user nova-compute[72894]:       </nova:owner>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:58:06 user nova-compute[72894]:       <nova:ports>
Aug 16 19:58:06 user nova-compute[72894]:         <nova:port uuid="63efa10d-cb37-4eaf-a1f4-0032c4f34cda">
Aug 16 19:58:06 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 19:58:06 user nova-compute[72894]:         </nova:port>
Aug 16 19:58:06 user nova-compute[72894]:       </nova:ports>
Aug 16 19:58:06 user nova-compute[72894]:     </nova:instance>
Aug 16 19:58:06 user nova-compute[72894]:   </metadata>
Aug 16 19:58:06 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:58:06 user nova-compute[72894]:     <system>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="serial">8221cae3-a185-4cff-bbb3-f20cf08e369b</entry>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="uuid">8221cae3-a185-4cff-bbb3-f20cf08e369b</entry>
Aug 16 19:58:06 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:58:06 user nova-compute[72894]:     </system>
Aug 16 19:58:06 user nova-compute[72894]:   </sysinfo>
Aug 16 19:58:06 user nova-compute[72894]:   <os>
Aug 16 19:58:06 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:58:06 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:58:06 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:58:06 user nova-compute[72894]:   </os>
Aug 16 19:58:06 user nova-compute[72894]:   <features>
Aug 16 19:58:06 user nova-compute[72894]:     <acpi/>
Aug 16 19:58:06 user nova-compute[72894]:     <apic/>
Aug 16 19:58:06 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:58:06 user nova-compute[72894]:   </features>
Aug 16 19:58:06 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:58:06 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:58:06 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:58:06 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:58:06 user nova-compute[72894]:   </clock>
Aug 16 19:58:06 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:58:06 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:58:06 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:58:06 user nova-compute[72894]:   </cpu>
Aug 16 19:58:06 user nova-compute[72894]:   <devices>
Aug 16 19:58:06 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:58:06 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:58:06 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk"/>
Aug 16 19:58:06 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:58:06 user nova-compute[72894]:     </disk>
Aug 16 19:58:06 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:58:06 user nova-compute[72894]:       <mac address="fa:16:3e:48:c3:9b"/>
Aug 16 19:58:06 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:06 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:58:06 user nova-compute[72894]:       <target dev="tap63efa10d-cb"/>
Aug 16 19:58:06 user nova-compute[72894]:     </interface>
Aug 16 19:58:06 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:58:06 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/console.log" append="off"/>
Aug 16 19:58:06 user nova-compute[72894]:     </serial>
Aug 16 19:58:06 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:58:06 user nova-compute[72894]:     <video>
Aug 16 19:58:06 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:06 user nova-compute[72894]:     </video>
Aug 16 19:58:06 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:58:06 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:58:06 user nova-compute[72894]:     </rng>
Aug 16 19:58:06 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:58:06 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:58:06 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:58:06 user nova-compute[72894]:     </memballoon>
Aug 16 19:58:06 user nova-compute[72894]:   </devices>
Aug 16 19:58:06 user nova-compute[72894]: </domain>
Aug 16 19:58:06 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1082279093',display_name='tempest-VolumesAssistedSnapshotsTest-server-1082279093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1082279093',id=5,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaW7bHo8ffed3n0hTz0IWiacz4bz1UJYwvP5zM/60aEoiE+tnp67mCnKGFzYgXBwun9xk5TAdbDzfYCk/kxDCK+vEXCKrJ3FokYruHlVeq3rnoUFnr0dCRf0NITvpVDQ==',key_name='tempest-keypair-667819731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='317ff567df974b26915a694ecef12434',ramdisk_id='',reservation_id='r-9emt5gf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-140938868',owner_user_name='tempest-VolumesAssistedSnapshotsTest-140938868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209ab74834804fa3b563882443745016',uuid=8221cae3-a185-4cff-bbb3-f20cf08e369b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converting VIF {"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG os_vif [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63efa10d-cb, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63efa10d-cb, col_values=(('external_ids', {'iface-id': '63efa10d-cb37-4eaf-a1f4-0032c4f34cda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:c3:9b', 'vm-uuid': '8221cae3-a185-4cff-bbb3-f20cf08e369b'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:06 user nova-compute[72894]: INFO os_vif [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb')
Aug 16 19:58:06 user nova-compute[72894]: INFO nova.compute.manager [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Took 9.65 seconds to build instance.
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] No VIF found with MAC fa:16:3e:48:c3:9b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f69e7e1b-b3d2-4fdf-ac78-4a6d6f5b2f15 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.804s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updated VIF entry in instance network info cache for port 63efa10d-cb37-4eaf-a1f4-0032c4f34cda. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updating instance_info_cache with network_info: [{"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88b924f0-053b-49ad-ae80-eb6bfd704cdf req-aa10f65e-a5a1-44a4-b756-f854589e2a6d service nova] Releasing lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] No waiting events found dispatching network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:08 user nova-compute[72894]: WARNING nova.compute.manager [req-f98fd94f-0b81-48ad-a305-130575e20f9b req-34c0129f-2a85-433e-842e-4db861033b03 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received unexpected event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda for instance with vm_state building and task_state spawning.
Aug 16 19:58:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] No waiting events found dispatching network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:10 user nova-compute[72894]: WARNING nova.compute.manager [req-301de623-6323-4d17-8d20-45b168ab16cc req-31a27087-7588-48ef-a5aa-26d95b64b8de service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received unexpected event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda for instance with vm_state building and task_state spawning.
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215890.6007617, 8221cae3-a185-4cff-bbb3-f20cf08e369b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] VM Resumed (Lifecycle Event)
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Instance spawned successfully.
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215890.6040661, 8221cae3-a185-4cff-bbb3-f20cf08e369b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] VM Started (Lifecycle Event)
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Took 7.12 seconds to spawn the instance on the hypervisor.
Aug 16 19:58:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:10 user nova-compute[72894]: INFO nova.compute.manager [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Took 8.36 seconds to build instance.
Aug 16 19:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ebd58bf5-7654-41dd-9ce5-f5aa7836f7a5 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.616s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:58:15 user nova-compute[72894]: INFO nova.compute.claims [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Claim successful on node user
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:58:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:58:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG nova.policy [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21bae0264e7d4b53b420644daf702684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaf7d30d23f445d8b52521dcfc637e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:58:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Creating image(s)
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.250s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.261s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk 1073741824" returned: 0 in 0.062s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.251s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Cannot resize image /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'migration_context' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Successfully created port: d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Ensure instance console log exists: /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Successfully updated port: d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-changed-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing instance network info cache due to event network-changed-d3642a60-024d-4af0-8353-7a6a9d6bb136. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Instance network_info: |[{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing network info cache for port d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Start _get_guest_xml network_info=[{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:58:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:58:19 user nova-compute[72894]:   <uuid>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</uuid>
Aug 16 19:58:19 user nova-compute[72894]:   <name>instance-00000006</name>
Aug 16 19:58:19 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:58:19 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:58:19 user nova-compute[72894]:   <metadata>
Aug 16 19:58:19 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:58:19 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:name>tempest-device-tagging-server-2063957319</nova:name>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:58:19</nova:creationTime>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:58:19 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:58:19 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:owner>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:user uuid="21bae0264e7d4b53b420644daf702684">tempest-TaggedAttachmentsTest-1281191126-project-member</nova:user>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:project uuid="ebaf7d30d23f445d8b52521dcfc637e2">tempest-TaggedAttachmentsTest-1281191126</nova:project>
Aug 16 19:58:19 user nova-compute[72894]:       </nova:owner>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:58:19 user nova-compute[72894]:       <nova:ports>
Aug 16 19:58:19 user nova-compute[72894]:         <nova:port uuid="d3642a60-024d-4af0-8353-7a6a9d6bb136">
Aug 16 19:58:19 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 19:58:19 user nova-compute[72894]:         </nova:port>
Aug 16 19:58:19 user nova-compute[72894]:       </nova:ports>
Aug 16 19:58:19 user nova-compute[72894]:     </nova:instance>
Aug 16 19:58:19 user nova-compute[72894]:   </metadata>
Aug 16 19:58:19 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:58:19 user nova-compute[72894]:     <system>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="serial">9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="uuid">9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 19:58:19 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:58:19 user nova-compute[72894]:     </system>
Aug 16 19:58:19 user nova-compute[72894]:   </sysinfo>
Aug 16 19:58:19 user nova-compute[72894]:   <os>
Aug 16 19:58:19 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:58:19 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:58:19 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:58:19 user nova-compute[72894]:   </os>
Aug 16 19:58:19 user nova-compute[72894]:   <features>
Aug 16 19:58:19 user nova-compute[72894]:     <acpi/>
Aug 16 19:58:19 user nova-compute[72894]:     <apic/>
Aug 16 19:58:19 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:58:19 user nova-compute[72894]:   </features>
Aug 16 19:58:19 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:58:19 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:58:19 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:58:19 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:58:19 user nova-compute[72894]:   </clock>
Aug 16 19:58:19 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:58:19 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:58:19 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:58:19 user nova-compute[72894]:   </cpu>
Aug 16 19:58:19 user nova-compute[72894]:   <devices>
Aug 16 19:58:19 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:58:19 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:58:19 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk"/>
Aug 16 19:58:19 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:58:19 user nova-compute[72894]:     </disk>
Aug 16 19:58:19 user nova-compute[72894]:     <disk type="file" device="cdrom">
Aug 16 19:58:19 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 19:58:19 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config"/>
Aug 16 19:58:19 user nova-compute[72894]:       <target dev="hda" bus="ide"/>
Aug 16 19:58:19 user nova-compute[72894]:     </disk>
Aug 16 19:58:19 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:58:19 user nova-compute[72894]:       <mac address="fa:16:3e:eb:a7:2d"/>
Aug 16 19:58:19 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:19 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:58:19 user nova-compute[72894]:       <target dev="tapd3642a60-02"/>
Aug 16 19:58:19 user nova-compute[72894]:     </interface>
Aug 16 19:58:19 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:58:19 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log" append="off"/>
Aug 16 19:58:19 user nova-compute[72894]:     </serial>
Aug 16 19:58:19 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:58:19 user nova-compute[72894]:     <video>
Aug 16 19:58:19 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:58:19 user nova-compute[72894]:     </video>
Aug 16 19:58:19 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:58:19 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:58:19 user nova-compute[72894]:     </rng>
Aug 16 19:58:19 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:58:19 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:58:19 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:58:19 user nova-compute[72894]:     </memballoon>
Aug 16 19:58:19 user nova-compute[72894]:   </devices>
Aug 16 19:58:19 user nova-compute[72894]: </domain>
Aug 16 19:58:19 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG os_vif [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3642a60-02, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3642a60-02, col_values=(('external_ids', {'iface-id': 'd3642a60-024d-4af0-8353-7a6a9d6bb136', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:a7:2d', 'vm-uuid': '9e9e5bd9-2ca4-49ef-a09a-927cf569be66'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:19 user nova-compute[72894]: INFO os_vif [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02')
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name hda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No VIF found with MAC fa:16:3e:eb:a7:2d, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:58:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Using config drive
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:19 user nova-compute[72894]: WARNING nova.compute.manager [req-5129dad6-fc4c-4e07-8369-6eda95f6c07c req-6f41dc9c-560b-4808-99a2-dc5267fb326d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state None.
Aug 16 19:58:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Creating config drive at /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkxnkwmas {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkxnkwmas" returned: 0 in 0.072s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updated VIF entry in instance network info cache for port d3642a60-024d-4af0-8353-7a6a9d6bb136. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:58:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96943f35-74a3-4faa-916a-5996d65bc421 req-b5d017a6-213b-4d29-9fbb-ef18adc8d35a service nova] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:21 user nova-compute[72894]: WARNING nova.compute.manager [req-29927e48-c820-4eab-8bca-5e6c11c8564d req-d07e9f96-e35b-4b78-b053-955a45aa4d9e service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state None.
Aug 16 19:58:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 19:58:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215904.2142684, 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] VM Resumed (Lifecycle Event)
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Instance spawned successfully.
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215904.2164268, 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] VM Started (Lifecycle Event)
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Took 8.28 seconds to spawn the instance on the hypervisor.
Aug 16 19:58:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:58:24 user nova-compute[72894]: INFO nova.compute.manager [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Took 9.61 seconds to build instance.
Aug 16 19:58:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-67f1c313-8278-499a-9508-0e20136c55e6 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.752s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:58:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:58:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:58:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:58:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=24.793807983398438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:58:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 8221cae3-a185-4cff-bbb3-f20cf08e369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] No waiting events found dispatching network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:32 user nova-compute[72894]: WARNING nova.compute.manager [req-3ab184ee-9a53-4624-a9de-a5d345d024c1 req-14c9357f-27db-4859-8089-36f2908bbb2a service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received unexpected event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d for instance with vm_state active and task_state None.
Aug 16 19:58:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] No waiting events found dispatching network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:34 user nova-compute[72894]: WARNING nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received unexpected event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d for instance with vm_state active and task_state None.
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:34 user nova-compute[72894]: WARNING nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 for instance with vm_state active and task_state None.
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:58:34 user nova-compute[72894]: WARNING nova.compute.manager [req-70f45d43-7bbf-47ed-bf1b-55c47813391a req-767176ce-e50a-485f-9246-00a4c2321353 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 for instance with vm_state active and task_state None.
Aug 16 19:58:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:58:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:59:03 user nova-compute[72894]: INFO nova.compute.claims [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Claim successful on node user
Aug 16 19:59:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 19:59:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.614s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:59:04 user nova-compute[72894]: INFO nova.compute.claims [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Claim successful on node user
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:59:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:59:04 user nova-compute[72894]: INFO nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Booting with volume 3e06385e-3b16-447c-a1c9-1cf37346d4ba at /dev/vda
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.policy [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10f14678cec34119a408b36cb99f7827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e523c246d424c31ba852e5234f416b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:04 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp985ehlvh/privsep.sock']
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:59:04 user sudo[83821]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp985ehlvh/privsep.sock
Aug 16 19:59:04 user sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 19:59:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:59:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:59:04 user nova-compute[72894]: INFO nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Booting with volume fcdc4762-8af4-405d-905a-ff5730a8db38 at /dev/vda
Aug 16 19:59:04 user nova-compute[72894]: DEBUG nova.policy [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1486c29d5df4d8087e0714694c881db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f9bc3b28c44328fd761ac44ca82bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:59:04 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully created port: 3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully created port: 0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully created port: 25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully created port: a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:06 user sudo[83821]: pam_unix(sudo:session): session closed for user root
Aug 16 19:59:06 user nova-compute[72894]: INFO oslo.privsep.daemon [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Spawned new privsep daemon via rootwrap
Aug 16 19:59:06 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 19:59:06 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 19:59:06 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 19:59:06 user nova-compute[72894]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83840
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4707ce-37ae-4122-873b-11368b3834d5]: (2,) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: WARNING oslo_privsep.priv_context [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] privsep daemon already running
Aug 16 19:59:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully created port: f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5584a92d-fd3f-425e-924a-ee8a1662f622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.nvmeof [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b2baa-6017-41db-9559-09abd63111f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5833a8a-a8c7-453e-a8bb-446fa3b4f13d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ee295-d236-4b3e-bf11-9a8872329a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ce59b-e1bb-4c7b-b785-70c7b3161338]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd155f11-9f3f-4415-b951-0c6e2e67e9a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[541d295d-1c8a-4f83-a401-72ad892434f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237b3ed-c7ae-48c1-adc5-aee05cf59158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:07 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7583a7bf-d74c-4c0c-85af-3693e8a7e8a9]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:07 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cba59d-ee22-4d4c-941b-6696239d9df5]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== get_connector_properties: return (2153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating existing volume attachment record: ad6c48ab-b7fe-46a9-8fe3-b703545f0b41 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== get_connector_properties: return (2545ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating existing volume attachment record: 31e77d7b-bce4-480c-a102-d0fd645a769f {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully created port: 41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully created port: d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully created port: 019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully created port: 247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully created port: 0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: 3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-3b0566f7-949c-414d-b1ff-91990d9ea863. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port 3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: 0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-0402f95a-9d72-4183-ad59-ba52ddfb8ab3. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074c551-fc6c-4cd3-af1c-ed19f4bedebf req-6fe6a75d-b19d-40ca-9f50-fc2e3aeec439 service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04395e21-95eb-4fec-be9e-6fe35a283573 req-ae7e8a3a-a65c-4f4e-98b8-e88643d0ac17 service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-bef2f44a-5979-4676-b04b-985c6b282de8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-baadd6e4-92da-47e6-9c23-d8020a9db4a0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: 2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-615a4367-7297-44d5-b581-b4317c68da57 req-b425ef47-01ff-42e5-ba97-ccf07a169ec6 service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4472b58d-c48f-4387-a2a6-96f1c6419091 req-796cab82-a348-466d-875f-9342323fbe8f service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:12 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: 25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-2411431b-e61d-4a10-803d-a64dee4b2c66. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-25145c72-85a5-4565-9880-593db50b9a9d. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port 25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4d5bed-05d7-4e8d-a92c-073a9d6f1d46 req-033e379f-91a7-424d-a833-9bd8eda5d03c service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: 41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-f91b4d66-eb76-4a91-a1f5-0968b3d40615. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c462c0e8-76e4-466b-8247-8833a37cdcb8 req-4bf83dc1-f22a-437f-95fe-b0568f608117 service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: 019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-41d15a98-37ee-447c-a70e-513bd31d05e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-d74bdb23-3d85-4fc3-bcba-cedb58966818. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:15 user nova-compute[72894]: DEBUG nova.network.neutron [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Successfully updated port: 247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-576a73b4-2912-4bbb-b3e5-be6c6898332e req-c0ffd56f-0e5c-4d2d-8c14-cd8d7fc3fa74 service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7b6f63a-7070-471b-8578-803ec8537b59 req-8b689575-4479-4b4d-96eb-1e409cd62648 service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Successfully updated port: 0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-247c5bea-e271-4bab-8241-b1bf4a121f5b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:19 user nova-compute[72894]: INFO nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Booting with volume aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 at /dev/vdb
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance network_info: |[{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port 247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ecbab7-b18d-4f62-8b10-adf268a62b07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2cc30c-86ab-4df3-909c-db8faa5fff93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb52c11-a900-4854-aca5-69e6650097e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d7c3c-3897-4e02-8672-5da7969b1a1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:19 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefc998-2cf8-42bf-8947-16f3aa359660]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating existing volume attachment record: de805ebf-b5ab-42d0-9f59-9d620470c517 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance network_info: |[{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updated VIF entry in instance network info cache for port 247c5bea-e271-4bab-8241-b1bf4a121f5b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9061d5-9d81-46a8-8c68-9e4d88a51605 req-18c53cb0-ad25-406a-9c87-03a1dda4803b service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:20 user nova-compute[72894]: INFO nova.compute.manager [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] instance snapshotting
Aug 16 19:59:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Beginning live snapshot process
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updated VIF entry in instance network info cache for port 019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-0bc24ff7-23fe-4627-b4e9-716376bb1288. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updated VIF entry in instance network info cache for port 0bc24ff7-23fe-4627-b4e9-716376bb1288. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4d6698f0-650a-4fd8-9c56-66c79c7f1ad1 req-c2b58517-bba7-40bf-8846-ff586641c57b service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.230s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd.delta 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd.delta 1073741824" returned: 0 in 0.054s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 19:59:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72894) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 19:59:21 user nova-compute[72894]: INFO nova.virt.libvirt.host [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] UEFI support detected
Aug 16 19:59:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 19:59:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 19:59:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 19:59:22 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:59:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd.delta /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd.delta /opt/stack/data/nova/instances/snapshots/tmpvqr7q6tf/51ec35dd19354ec1bdf16536aa975fdd" returned: 0 in 0.445s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Snapshot extracted, beginning image upload
Aug 16 19:59:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Snapshot image upload complete
Aug 16 19:59:26 user nova-compute[72894]: INFO nova.compute.manager [None req-93a36483-58b1-444e-a38b-0d6073c739ba tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Took 5.96 seconds to snapshot the instance on the hypervisor.
Aug 16 19:59:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing instance network info cache due to event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated VIF entry in instance network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9568be92-53b7-4702-9d3d-72f46dbe07a1 req-bb7a55f7-2fef-4b4e-9834-03c467e9e82d service nova] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-changed-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Refreshing instance network info cache due to event network-changed-2ea3d08c-315a-4008-917c-b629398a8b98. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Refreshing network info cache for port 2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updated VIF entry in instance network info cache for port 2ea3d08c-315a-4008-917c-b629398a8b98. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-723ef2af-3521-4532-9aa2-fa778e6b4c32 req-bb97ce19-16f6-44fe-9125-7d0205fb2138 service nova] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=24.700515747070312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 8221cae3-a185-4cff-bbb3-f20cf08e369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 54ca09d8-e407-4053-8a27-e318b74211b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:59:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:59:31 user nova-compute[72894]: INFO nova.compute.claims [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Claim successful on node user
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:59:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.policy [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6a1f78a8b054f0b84c5bcbc1fa8c286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd50fd8a7134bb2882624b5a221cfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:59:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Creating image(s)
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "/opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "/opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: INFO nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Booting with volume 41110941-7a45-4e9f-99ac-7a66437fb646 at /dev/vdc
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c76bbbe-dd8f-44d2-be64-2c62cd3a9333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[677bb4bf-d2b0-419a-968d-1dac6b9bb1bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade9e5a7-26f6-43c7-9199-8178951a8f5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[33495c2a-d2ae-4aff-a697-98e4dc3b856c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:32 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa2821-6944-4230-8943-5281ce0d117d]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG os_brick.utils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating existing volume attachment record: 10887d73-d045-41a2-b83c-d3611cef2eee {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk 1073741824" returned: 0 in 0.051s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Successfully created port: da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:59:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Cannot resize image /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'migration_context' on Instance uuid f2eaee09-d1ec-429f-a7a2-90f8bd930e13 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Ensure instance console log exists: /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Successfully updated port: da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquired lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-changed-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Refreshing instance network info cache due to event network-changed-da5c5c95-1f0d-4f02-aecc-590f94f6b75f. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] Acquiring lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Updating instance_info_cache with network_info: [{"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Releasing lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Instance network_info: |[{"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] Acquired lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Refreshing network info cache for port da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Start _get_guest_xml network_info=[{"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:59:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:59:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-260289859',display_name='tempest-VolumesActionsTest-instance-260289859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-260289859',id=9,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-yrx9myi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:32Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=f2eaee09-d1ec-429f-a7a2-90f8bd930e13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'pci_devices' on Instance uuid f2eaee09-d1ec-429f-a7a2-90f8bd930e13 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:59:34 user nova-compute[72894]:   <uuid>f2eaee09-d1ec-429f-a7a2-90f8bd930e13</uuid>
Aug 16 19:59:34 user nova-compute[72894]:   <name>instance-00000009</name>
Aug 16 19:59:34 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:59:34 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:59:34 user nova-compute[72894]:   <metadata>
Aug 16 19:59:34 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:59:34 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:name>tempest-VolumesActionsTest-instance-260289859</nova:name>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:59:33</nova:creationTime>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:59:34 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:59:34 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:owner>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:user uuid="e6a1f78a8b054f0b84c5bcbc1fa8c286">tempest-VolumesActionsTest-448586114-project-member</nova:user>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:project uuid="fcd50fd8a7134bb2882624b5a221cfa1">tempest-VolumesActionsTest-448586114</nova:project>
Aug 16 19:59:34 user nova-compute[72894]:       </nova:owner>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:59:34 user nova-compute[72894]:       <nova:ports>
Aug 16 19:59:34 user nova-compute[72894]:         <nova:port uuid="da5c5c95-1f0d-4f02-aecc-590f94f6b75f">
Aug 16 19:59:34 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 19:59:34 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:34 user nova-compute[72894]:       </nova:ports>
Aug 16 19:59:34 user nova-compute[72894]:     </nova:instance>
Aug 16 19:59:34 user nova-compute[72894]:   </metadata>
Aug 16 19:59:34 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:59:34 user nova-compute[72894]:     <system>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="serial">f2eaee09-d1ec-429f-a7a2-90f8bd930e13</entry>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="uuid">f2eaee09-d1ec-429f-a7a2-90f8bd930e13</entry>
Aug 16 19:59:34 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:59:34 user nova-compute[72894]:     </system>
Aug 16 19:59:34 user nova-compute[72894]:   </sysinfo>
Aug 16 19:59:34 user nova-compute[72894]:   <os>
Aug 16 19:59:34 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:59:34 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:59:34 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:59:34 user nova-compute[72894]:   </os>
Aug 16 19:59:34 user nova-compute[72894]:   <features>
Aug 16 19:59:34 user nova-compute[72894]:     <acpi/>
Aug 16 19:59:34 user nova-compute[72894]:     <apic/>
Aug 16 19:59:34 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:59:34 user nova-compute[72894]:   </features>
Aug 16 19:59:34 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:59:34 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:59:34 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:59:34 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:59:34 user nova-compute[72894]:   </clock>
Aug 16 19:59:34 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:59:34 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:59:34 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:59:34 user nova-compute[72894]:   </cpu>
Aug 16 19:59:34 user nova-compute[72894]:   <devices>
Aug 16 19:59:34 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 19:59:34 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:59:34 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk"/>
Aug 16 19:59:34 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:59:34 user nova-compute[72894]:     </disk>
Aug 16 19:59:34 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:34 user nova-compute[72894]:       <mac address="fa:16:3e:35:e4:0f"/>
Aug 16 19:59:34 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:34 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:34 user nova-compute[72894]:       <target dev="tapda5c5c95-1f"/>
Aug 16 19:59:34 user nova-compute[72894]:     </interface>
Aug 16 19:59:34 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:59:34 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/console.log" append="off"/>
Aug 16 19:59:34 user nova-compute[72894]:     </serial>
Aug 16 19:59:34 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:59:34 user nova-compute[72894]:     <video>
Aug 16 19:59:34 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:34 user nova-compute[72894]:     </video>
Aug 16 19:59:34 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:59:34 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:59:34 user nova-compute[72894]:     </rng>
Aug 16 19:59:34 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:59:34 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:59:34 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:59:34 user nova-compute[72894]:     </memballoon>
Aug 16 19:59:34 user nova-compute[72894]:   </devices>
Aug 16 19:59:34 user nova-compute[72894]: </domain>
Aug 16 19:59:34 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-260289859',display_name='tempest-VolumesActionsTest-instance-260289859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-260289859',id=9,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-yrx9myi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:32Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=f2eaee09-d1ec-429f-a7a2-90f8bd930e13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_vif [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda5c5c95-1f, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda5c5c95-1f, col_values=(('external_ids', {'iface-id': 'da5c5c95-1f0d-4f02-aecc-590f94f6b75f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:e4:0f', 'vm-uuid': 'f2eaee09-d1ec-429f-a7a2-90f8bd930e13'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:34 user nova-compute[72894]: INFO os_vif [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f')
Aug 16 19:59:34 user nova-compute[72894]: INFO nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Booting with volume 57ef553d-1f6f-420d-92e1-60f69eb98b59 at /dev/vdb
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] No VIF found with MAC fa:16:3e:35:e4:0f, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[331143be-626f-4cbe-9f98-c7bce61169ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae21b00f-253e-4aa0-99b5-b5d5c49ea65b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e273c24-98e9-4e20-a8ee-2c166deca330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e3874-4c7f-4e44-9291-bc9789fc54ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:34 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69cf87c-25ac-499a-b97b-20a04fec2b69]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating existing volume attachment record: 8bd7f2f2-7e65-44b0-8c7d-800248bf773c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.neutron [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Updated VIF entry in instance network info cache for port da5c5c95-1f0d-4f02-aecc-590f94f6b75f. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG nova.network.neutron [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Updating instance_info_cache with network_info: [{"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-91af92fc-15d8-4734-a365-fc59b189403e req-36b01236-c3c6-4dab-8216-55566da331c3 service nova] Releasing lock "refresh_cache-f2eaee09-d1ec-429f-a7a2-90f8bd930e13" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] No waiting events found dispatching network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:35 user nova-compute[72894]: WARNING nova.compute.manager [req-33cb1dc8-e00e-403a-a160-3080372a7694 req-fc84c834-b162-4329-a817-d610e40f4303 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received unexpected event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f for instance with vm_state building and task_state spawning.
Aug 16 19:59:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215977.6422, f2eaee09-d1ec-429f-a7a2-90f8bd930e13 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] VM Resumed (Lifecycle Event)
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Instance spawned successfully.
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215977.647694, f2eaee09-d1ec-429f-a7a2-90f8bd930e13 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] VM Started (Lifecycle Event)
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] No waiting events found dispatching network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:37 user nova-compute[72894]: WARNING nova.compute.manager [req-645a6c15-fb32-487b-8597-9b6b483d5c29 req-aec43dfe-6d25-4c8f-b1ba-a780b06c03c6 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received unexpected event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f for instance with vm_state building and task_state spawning.
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 16 19:59:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:37 user nova-compute[72894]: INFO nova.compute.manager [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Took 6.42 seconds to build instance.
Aug 16 19:59:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b5323030-425d-4b02-84a7-eb742803bfd3 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.566s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:59:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Creating image(s)
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Ensure instance console log exists: /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Start _get_guest_xml network_info=[{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ad6c48ab-b7fe-46a9-8fe3-b703545f0b41', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdkIGKOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcdc4762-8af4-405d-905a-ff5730a8db38', 'serial': 'fcdc4762-8af4-405d-905a-ff5730a8db38'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'de805ebf-b5ab-42d0-9f59-9d620470c517', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spnGZqBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80', 'attached_at': '', 'detached_at': '', 'volume_id': 'aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7', 'serial': 'aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7'}, 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '10887d73-d045-41a2-b83c-d3611cef2eee', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrCqdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80', 'attached_at': '', 'detached_at': '', 'volume_id': '41110941-7a45-4e9f-99ac-7a66437fb646', 'serial': '41110941-7a45-4e9f-99ac-7a66437fb646'}, 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:59:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connector [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Factory for ISCSI on None {{(pid=72894) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdkIGKOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:43 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:43 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:43 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:59:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f60685-f416-4156-9bc9-1594eb8dd3ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:59:44 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2eeed-e1c7-44bb-bee7-16472d24a7a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38] added
Aug 16 19:59:44 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7d582-0bd0-4d5d-a589-bbfe25f3528c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea63702-f1fd-4237-b125-602b42017006]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdkIGKOj {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdkIGKOj" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6626f34-f4e0-471e-8694-84f759f50ce6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AdkIGKOj'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527b47a-cb21-487a-937f-81fa28bbcca0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad5f84-7380-4379-806d-6d6213fb95da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:59:44 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:59:44 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:44 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 19:59:44 user nova-compute[72894]: 
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e78fa-be0a-448f-9f1b-3916ea80115b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260]
Aug 16 19:59:44 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260] successful.
Aug 16 19:59:44 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e6d0d2-4ed7-4e98-b09c-ec1f771f8418]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e0db0-99a8-4679-8df2-57251689637e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:44 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:44 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57ef6b-d38d-4d74-b6bb-af5876836423]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:59:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdkIGKOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23231666137636236', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231666137636236', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spnGZqBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:45 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3499cf-b85c-46a6-8135-24eaf119b6f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:59:45 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d964f8-6b5e-4535-b411-f2e1c50e175e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7] added
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[72feceb4-1fef-420d-a478-36072dececb9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b248799-f932-44fd-9463-a6e188038065]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spnGZqBT {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spnGZqBT" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30485579-1915-48b8-8e04-36b6d699bd65]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spnGZqBT'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[121072df-b649-4822-a2a8-fa734bc5dae7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc363e-1aa0-4b69-91d1-3e3abb17082e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d62f8-abab-4e4e-899d-0cecd71eb700]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260]
Aug 16 19:59:45 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260] successful.
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f974aa-5b87-4d24-a466-b7bec5b3a3f5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d2eff-e2e8-41df-bf69-41fcfcc00e95]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeaa52c-4d20-46c8-bc76-28cb393c9df0]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:59:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spnGZqBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26233663762386331', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233663762386331', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrCqdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:46 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:46 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:59:46 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc573bb-4b7a-4ebc-9edd-fd93e435d497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:59:46 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c165e0d-2d16-4d17-96c2-4a785ec8f362]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646] added
Aug 16 19:59:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf316a2-4e5f-4c73-89be-5cc463fe55ae]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4262d197-91fd-4f8f-ae05-60eb702e89e3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETrCqdGH {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETrCqdGH" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e720a-38f0-4bea-8804-688f88bb9eb4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETrCqdGH'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ebe1a6-5aab-4933-b4af-f26c7078a467]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8497e31-47e2-40bb-b96f-f30a23cfd445]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:46 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:46 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383fda1-c4ff-41e4-bb42-42b5049d7e05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260]
Aug 16 19:59:46 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260] successful.
Aug 16 19:59:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.139s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79f3c9-9eb8-449c-83e4-a7fa2e2514fa]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9318ea88-54ae-4418-a0f9-9d90c605c607]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 19:59:47 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[96225e7b-e0c0-440c-8c90-f651c1342eba]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-changed-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Refreshing instance network info cache due to event network-changed-642f6751-1a5e-4b1e-bd3b-b96a0911456d. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] Acquiring lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] Acquired lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Refreshing network info cache for port 642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrCqdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23736393665346531', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736393665346531', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:59:48 user nova-compute[72894]:   <uuid>1f02f480-8b2c-42c6-b7e7-bc8d397daa80</uuid>
Aug 16 19:59:48 user nova-compute[72894]:   <name>instance-00000008</name>
Aug 16 19:59:48 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 19:59:48 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 19:59:48 user nova-compute[72894]:   <metadata>
Aug 16 19:59:48 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:59:48 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:name>tempest-device-tagging-server-1902308200</nova:name>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:creationTime>2023-08-16 19:59:43</nova:creationTime>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 19:59:48 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:59:48 user nova-compute[72894]:       </nova:flavor>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:owner>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:user uuid="b1486c29d5df4d8087e0714694c881db">tempest-TaggedBootDevicesTest_v242-378966607-project-member</nova:user>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:project uuid="0e1f9bc3b28c44328fd761ac44ca82bb">tempest-TaggedBootDevicesTest_v242-378966607</nova:project>
Aug 16 19:59:48 user nova-compute[72894]:       </nova:owner>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 19:59:48 user nova-compute[72894]:       <nova:ports>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="0402f95a-9d72-4183-ad59-ba52ddfb8ab3">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="baadd6e4-92da-47e6-9c23-d8020a9db4a0">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="2411431b-e61d-4a10-803d-a64dee4b2c66">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="a65c2a88-d2e7-4bfd-b12e-752cf16bddbc">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="41d15a98-37ee-447c-a70e-513bd31d05e8">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:         <nova:port uuid="0bc24ff7-23fe-4627-b4e9-716376bb1288">
Aug 16 19:59:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 19:59:48 user nova-compute[72894]:         </nova:port>
Aug 16 19:59:48 user nova-compute[72894]:       </nova:ports>
Aug 16 19:59:48 user nova-compute[72894]:     </nova:instance>
Aug 16 19:59:48 user nova-compute[72894]:   </metadata>
Aug 16 19:59:48 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 19:59:48 user nova-compute[72894]:     <system>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="serial">1f02f480-8b2c-42c6-b7e7-bc8d397daa80</entry>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="uuid">1f02f480-8b2c-42c6-b7e7-bc8d397daa80</entry>
Aug 16 19:59:48 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:59:48 user nova-compute[72894]:     </system>
Aug 16 19:59:48 user nova-compute[72894]:   </sysinfo>
Aug 16 19:59:48 user nova-compute[72894]:   <os>
Aug 16 19:59:48 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:59:48 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 19:59:48 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 19:59:48 user nova-compute[72894]:   </os>
Aug 16 19:59:48 user nova-compute[72894]:   <features>
Aug 16 19:59:48 user nova-compute[72894]:     <acpi/>
Aug 16 19:59:48 user nova-compute[72894]:     <apic/>
Aug 16 19:59:48 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 19:59:48 user nova-compute[72894]:   </features>
Aug 16 19:59:48 user nova-compute[72894]:   <clock offset="utc">
Aug 16 19:59:48 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:59:48 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:59:48 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 19:59:48 user nova-compute[72894]:   </clock>
Aug 16 19:59:48 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 19:59:48 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 19:59:48 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:59:48 user nova-compute[72894]:   </cpu>
Aug 16 19:59:48 user nova-compute[72894]:   <devices>
Aug 16 19:59:48 user nova-compute[72894]:     <disk type="file" device="cdrom">
Aug 16 19:59:48 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 19:59:48 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/disk.config"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="hda" bus="ide"/>
Aug 16 19:59:48 user nova-compute[72894]:     </disk>
Aug 16 19:59:48 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 19:59:48 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:59:48 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <serial>fcdc4762-8af4-405d-905a-ff5730a8db38</serial>
Aug 16 19:59:48 user nova-compute[72894]:     </disk>
Aug 16 19:59:48 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 19:59:48 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:59:48 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <serial>aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7</serial>
Aug 16 19:59:48 user nova-compute[72894]:     </disk>
Aug 16 19:59:48 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 19:59:48 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:59:48 user nova-compute[72894]:       <source dev="/dev/sdd"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="vdc" bus="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <serial>41110941-7a45-4e9f-99ac-7a66437fb646</serial>
Aug 16 19:59:48 user nova-compute[72894]:     </disk>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:f1:74:09"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tap0402f95a-9d"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:29:ac:db"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tapbaadd6e4-92"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:67:f5:d6"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tap2411431b-e6"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:9d:03:54"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tapa65c2a88-d2"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:fc:65:ad"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tap41d15a98-37"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:ac:9d:89"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tap019acb8b-ce"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 19:59:48 user nova-compute[72894]:       <mac address="fa:16:3e:74:5c:ce"/>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 19:59:48 user nova-compute[72894]:       <target dev="tap0bc24ff7-23"/>
Aug 16 19:59:48 user nova-compute[72894]:     </interface>
Aug 16 19:59:48 user nova-compute[72894]:     <serial type="pty">
Aug 16 19:59:48 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/console.log" append="off"/>
Aug 16 19:59:48 user nova-compute[72894]:     </serial>
Aug 16 19:59:48 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:59:48 user nova-compute[72894]:     <video>
Aug 16 19:59:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 19:59:48 user nova-compute[72894]:     </video>
Aug 16 19:59:48 user nova-compute[72894]:     <rng model="virtio">
Aug 16 19:59:48 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:59:48 user nova-compute[72894]:     </rng>
Aug 16 19:59:48 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:59:48 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 19:59:48 user nova-compute[72894]:       <stats period="10"/>
Aug 16 19:59:48 user nova-compute[72894]:     </memballoon>
Aug 16 19:59:48 user nova-compute[72894]:   </devices>
Aug 16 19:59:48 user nova-compute[72894]: </domain>
Aug 16 19:59:48 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0402f95a-9d, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0402f95a-9d, col_values=(('external_ids', {'iface-id': '0402f95a-9d72-4183-ad59-ba52ddfb8ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:74:09', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaadd6e4-92, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbaadd6e4-92, col_values=(('external_ids', {'iface-id': 'baadd6e4-92da-47e6-9c23-d8020a9db4a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ac:db', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2411431b-e6, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2411431b-e6, col_values=(('external_ids', {'iface-id': '2411431b-e61d-4a10-803d-a64dee4b2c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:f5:d6', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65c2a88-d2, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa65c2a88-d2, col_values=(('external_ids', {'iface-id': 'a65c2a88-d2e7-4bfd-b12e-752cf16bddbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:03:54', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d15a98-37, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41d15a98-37, col_values=(('external_ids', {'iface-id': '41d15a98-37ee-447c-a70e-513bd31d05e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:65:ad', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap019acb8b-ce, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap019acb8b-ce, col_values=(('external_ids', {'iface-id': '019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9d:89', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updated VIF entry in instance network info cache for port 642f6751-1a5e-4b1e-bd3b-b96a0911456d. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating instance_info_cache with network_info: [{"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b4c8ac-ed57-4afc-a7e8-0045130c990b req-1288629e-defa-4e4c-b184-bb17ffc1a714 service nova] Releasing lock "refresh_cache-91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bc24ff7-23, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bc24ff7-23, col_values=(('external_ids', {'iface-id': '0bc24ff7-23fe-4627-b4e9-716376bb1288', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:5c:ce', 'vm-uuid': '1f02f480-8b2c-42c6-b7e7-bc8d397daa80'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:48 user nova-compute[72894]: INFO os_vif [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23')
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] No BDM found with device name hda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] No VIF found with MAC fa:16:3e:f1:74:09, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] No VIF found with MAC fa:16:3e:fc:65:ad, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:59:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Using config drive
Aug 16 19:59:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Creating config drive at /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/disk.config
Aug 16 19:59:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcevl570w {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcevl570w" returned: 0 in 0.060s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:50 user nova-compute[72894]: WARNING nova.compute.manager [req-4074d699-871b-43e5-8b97-e85560358782 req-f8c64fa2-4cef-4d7e-88ca-0f18a0c616ce service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 for instance with vm_state building and task_state spawning.
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:50 user nova-compute[72894]: WARNING nova.compute.manager [req-b7546ed6-313b-44c1-a788-a5b48863446d req-307f8ff3-e70c-4e65-9f85-824c1a7b7d0b service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 for instance with vm_state building and task_state spawning.
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:52 user nova-compute[72894]: WARNING nova.compute.manager [req-5b65b487-c1ab-4846-b88e-f29b66938a8a req-3e7ff585-3a1d-42c0-896c-aa346fbe0497 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc for instance with vm_state building and task_state spawning.
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:52 user nova-compute[72894]: WARNING nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 for instance with vm_state building and task_state spawning.
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:52 user nova-compute[72894]: WARNING nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 for instance with vm_state building and task_state spawning.
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:52 user nova-compute[72894]: WARNING nova.compute.manager [req-30c496e6-a872-411a-af2a-f50bee91f4c0 req-77378bd9-1ff7-4c33-b634-11ee6af4ece9 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 for instance with vm_state building and task_state spawning.
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG nova.objects.instance [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'flavor' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:53 user nova-compute[72894]: WARNING nova.compute.manager [req-100c6b6f-7bd6-42eb-97a6-71f1e80fdaeb req-f508c0a9-a01b-437e-97a0-1c6bcd12cf36 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 for instance with vm_state building and task_state spawning.
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:53 user nova-compute[72894]: INFO nova.compute.manager [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Attaching volume 87c38432-16b1-4a1f-bd9f-9cb4b1794dfe to /dev/sdc
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.utils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be04471-e0a9-41b3-9884-1698c6d4310b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00644233-58fc-43f4-89ef-caf074a30b67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[585433bb-8c8f-497b-a4cc-abc50b1cb105]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a597a498-47c1-4dca-9718-3817ac1967cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:53 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f51a69-e1ff-4ca1-9387-a437aec3220e]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG os_brick.utils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating existing volume attachment record: 60195f22-f4e1-4f7e-af8e-6625a741e845 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lazy-loading 'flavor' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: INFO nova.compute.manager [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Attaching volume fd341fa6-a020-4fc0-b93d-91634a44d103 to /dev/vdb
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.utils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc for instance with vm_state building and task_state spawning.
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 for instance with vm_state building and task_state spawning.
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING nova.compute.manager [req-b7f8f471-23ef-4887-97a5-4ea52810dbe2 req-8ce293b5-35fc-4f07-b5ff-7b6b113fea80 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 for instance with vm_state building and task_state spawning.
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf6831-b3e9-49a4-b910-98cf28830aad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[68874ab0-eae0-44d5-9587-a247fa50b568]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84631b5-209b-497d-a666-d1e62c5fa752]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c47567f-af3d-4ad3-9894-176104a6af58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4ef946-6a06-46fc-9c45-36be8dfd852c]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.utils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updating existing volume attachment record: f7938426-3215-4e92-bceb-61b6e8779ac9 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 for instance with vm_state building and task_state spawning.
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING nova.compute.manager [req-a0164cfa-462f-49bc-910b-ad1fab3a5d62 req-e4a6c990-e2a7-4551-b495-135630f082c0 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 for instance with vm_state building and task_state spawning.
Aug 16 19:59:54 user nova-compute[72894]: INFO nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Booting with volume 163871a6-414b-410e-9054-67b29509a445 at /dev/vdc
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c583a-1624-4fb2-8367-17ff0cacc837]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973a9d6-87e5-4882-adca-b08b4ee26eeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c2d541-bf38-4dd8-8390-6b789dd45bb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05917f1-a109-4acd-b776-985003d68d44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:59:54 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:59:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77428343-f772-44aa-a0bf-da8319a90a20]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG os_brick.utils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:59:54 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating existing volume attachment record: 9438f251-2591-42ad-9e3d-8b1877934f18 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:55 user nova-compute[72894]: WARNING nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c for instance with vm_state building and task_state spawning.
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-changed-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Refreshing instance network info cache due to event network-changed-63efa10d-cb37-4eaf-a1f4-0032c4f34cda. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Acquiring lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Acquired lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.network.neutron [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Refreshing network info cache for port 63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215995.1805818, 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] VM Resumed (Lifecycle Event)
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance spawned successfully.
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692215995.190471, 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] VM Started (Lifecycle Event)
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Took 11.42 seconds to spawn the instance on the hypervisor.
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:59:55 user nova-compute[72894]: INFO nova.compute.manager [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Took 51.99 seconds to build instance.
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5eda964d-f561-4e49-9724-19188c9aeccd tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.138s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.network.neutron [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updated VIF entry in instance network info cache for port 63efa10d-cb37-4eaf-a1f4-0032c4f34cda. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.network.neutron [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updating instance_info_cache with network_info: [{"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Releasing lock "refresh_cache-8221cae3-a185-4cff-bbb3-f20cf08e369b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:59:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:59:55 user nova-compute[72894]: WARNING nova.compute.manager [req-eb49793d-5aee-4f99-98ea-974df10ab33c req-42ce4267-56e8-4ee1-9766-da9f3e3314a6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c for instance with vm_state building and task_state spawning.
Aug 16 19:59:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:59:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-changed-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing instance network info cache due to event network-changed-d3642a60-024d-4af0-8353-7a6a9d6bb136. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:00:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing network info cache for port d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcWnCSAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:06 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde3285-565f-4b0b-9c0d-8b4b898b5f25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:06 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[41be79dc-c612-44c2-9034-622e8cfe9b79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103] added
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fed197-2f71-465d-bad7-5abd25a1f3c2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f554a580-5e72-4221-89df-d81c40f43ac2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcWnCSAu {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcWnCSAu" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a9edfe-c1c1-4ede-9d65-e2098504a72b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcWnCSAu'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c2a4f-56ac-4042-8f44-89f8932e74bd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78145f9d-24d2-46e6-86ac-130c65664e7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updated VIF entry in instance network info cache for port d3642a60-024d-4af0-8353-7a6a9d6bb136. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9628c06f-9d59-479d-b678-fb5eed21105b req-a4185a6f-dede-467a-a0d8-bfb57c9cfb3d service nova] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[69051861-46c3-4bb1-abec-fa7d7b3e69da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260]
Aug 16 20:00:06 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e698b09-f947-4f87-85ed-4204b5bd7498]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'flavor' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f29085-5263-4afb-8b80-5a77c60fb54d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef05051-3d8f-47a7-a10c-65521e86653c]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcWnCSAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'pci_requests' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG nova.policy [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21bae0264e7d4b53b420644daf702684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebaf7d30d23f445d8b52521dcfc637e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26466616161656333', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466616161656333', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lazy-loading 'flavor' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 20:00:07 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:07 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:00:07 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:07 user nova-compute[72894]:   <serial>fd341fa6-a020-4fc0-b93d-91634a44d103</serial>
Aug 16 20:00:07 user nova-compute[72894]: </disk>
Aug 16 20:00:07 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:00:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Successfully created port: cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] No VIF found with MAC fa:16:3e:48:c3:9b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-007008a6-79ef-4905-a01d-d6e6302f1967 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.133s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Successfully updated port: cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-changed-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing instance network info cache due to event network-changed-cce01aaf-4443-4dc2-8fcf-601daa33bdbc. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] volume_snapshot_create: create_info: {'snapshot_id': 'b5171612-7677-431a-932a-0c2214cff4fa', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72894) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] snap xml: <domainsnapshot>
Aug 16 20:00:08 user nova-compute[72894]:   <disks>
Aug 16 20:00:08 user nova-compute[72894]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 16 20:00:08 user nova-compute[72894]:       <source file="/dev/new_file"/>
Aug 16 20:00:08 user nova-compute[72894]:     </disk>
Aug 16 20:00:08 user nova-compute[72894]:     <disk name="vda" snapshot="no"/>
Aug 16 20:00:08 user nova-compute[72894]:   </disks>
Aug 16 20:00:08 user nova-compute[72894]: </domainsnapshot>
Aug 16 20:00:08 user nova-compute[72894]:  {{(pid=72894) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lazy-loading 'system_metadata' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3dc7f425-022b-4fac-8793-2c70a8e425e5 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] volume_snapshot_delete: delete_info: {'volume_id': 'fd341fa6-a020-4fc0-b93d-91634a44d103'} {{(pid=72894) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [None req-3dc7f425-022b-4fac-8793-2c70a8e425e5 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     if delete_info['type'] != 'qcow2':
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] KeyError: 'type'
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] 
Aug 16 20:00:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     rv = execute(f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     six.reraise(c, e, tb)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     raise value
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     rv = meth(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     self._volume_snapshot_create(context, instance, guest,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     rv = execute(f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     six.reraise(c, e, tb)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     raise value
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     rv = meth(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [None req-3dc7f425-022b-4fac-8793-2c70a8e425e5 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5247627a-5bdf-4923-aff9-9d53850cb505)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server [None req-3dc7f425-022b-4fac-8793-2c70a8e425e5 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b5171612-7677-431a-932a-0c2214cff4fa could not be found.
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b5171612-7677-431a-932a-0c2214cff4fa could not be found. (HTTP 404) (Request-ID: req-a3bf3929-2fe0-492f-af5f-88b5de243508)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b5171612-7677-431a-932a-0c2214cff4fa could not be found.
Aug 16 20:00:08 user nova-compute[72894]: ERROR nova.virt.libvirt.driver 
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server [None req-ab39b128-c6b2-4078-99a1-b16485e9a581 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 20:00:08 user nova-compute[72894]: ERROR oslo_messaging.rpc.server 
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:08 user nova-compute[72894]: INFO nova.compute.manager [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Detaching volume fd341fa6-a020-4fc0-b93d-91634a44d103
Aug 16 20:00:09 user nova-compute[72894]: INFO nova.virt.block_device [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Attempting to driver detach volume fd341fa6-a020-4fc0-b93d-91634a44d103 from mountpoint /dev/vdb
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Attempting to detach device vdb from instance 8221cae3-a185-4cff-bbb3-f20cf08e369b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:09 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:09 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:00:09 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:09 user nova-compute[72894]:   <serial>fd341fa6-a020-4fc0-b93d-91634a44d103</serial>
Aug 16 20:00:09 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:00:09 user nova-compute[72894]: </disk>
Aug 16 20:00:09 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Successfully detached device vdb from instance 8221cae3-a185-4cff-bbb3-f20cf08e369b from the persistent domain config.
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8221cae3-a185-4cff-bbb3-f20cf08e369b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:09 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:09 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:00:09 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:09 user nova-compute[72894]:   <serial>fd341fa6-a020-4fc0-b93d-91634a44d103</serial>
Aug 16 20:00:09 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:00:09 user nova-compute[72894]: </disk>
Aug 16 20:00:09 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Refreshing network info cache for port cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_vif [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcce01aaf-44, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcce01aaf-44, col_values=(('external_ids', {'iface-id': 'cce01aaf-4443-4dc2-8fcf-601daa33bdbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:89:2b', 'vm-uuid': '9e9e5bd9-2ca4-49ef-a09a-927cf569be66'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: INFO os_vif [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44')
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] attach device xml: <interface type="ethernet">
Aug 16 20:00:09 user nova-compute[72894]:   <mac address="fa:16:3e:fe:89:2b"/>
Aug 16 20:00:09 user nova-compute[72894]:   <model type="virtio"/>
Aug 16 20:00:09 user nova-compute[72894]:   <mtu size="1442"/>
Aug 16 20:00:09 user nova-compute[72894]:   <target dev="tapcce01aaf-44"/>
Aug 16 20:00:09 user nova-compute[72894]: </interface>
Aug 16 20:00:09 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:09 user nova-compute[72894]: WARNING nova.compute.manager [req-810ecc46-bf69-4f9e-af64-b1395086a8c4 req-828880bd-f56d-433b-ae3d-b28fb7984a10 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc for instance with vm_state active and task_state None.
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbQzXGZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:09 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216009.5501273, 8221cae3-a185-4cff-bbb3-f20cf08e369b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdafb1a0-3718-4e2e-b11f-537a9ae72a3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:09 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Successfully detached device vdb from instance 8221cae3-a185-4cff-bbb3-f20cf08e369b from the live domain config.
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcWnCSAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d765d3-78cd-4fee-9b59-ee1b31df2be7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe] added
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1726affb-6e12-4469-b57b-08953c3d74be]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f32803-e117-4ebb-8fd0-9facfbcdf64a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbQzXGZY {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbQzXGZY" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321e103-2759-4862-badc-619d488ffd2a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbQzXGZY'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9107d85-341e-4ee3-933b-bb6506a0ff96]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updated VIF entry in instance network info cache for port cce01aaf-4443-4dc2-8fcf-601daa33bdbc. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e088e2a-b6d9-431d-b0be-caaf8af6c554 req-67361352-eab9-4fa5-8029-84e1955bc49d service nova] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f1b1f-c30f-4221-9e6b-dbf99af6fad2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8864a244-0936-4549-96b7-5bb5efdbdcbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260]
Aug 16 20:00:09 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd9ad9-eaef-4ad1-8b3d-b051ff082213]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a70cba-c2c0-4739-97b1-8b04daa957b2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:09 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d2077-bd04-48ff-88e1-63fbe74b331b]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbQzXGZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name hda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No VIF found with MAC fa:16:3e:eb:a7:2d, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:10 user nova-compute[72894]:   <nova:package version="0.0.0"/>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:name>tempest-device-tagging-server-2063957319</nova:name>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:creationTime>2023-08-16 20:00:10</nova:creationTime>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:flavor name="m1.tiny">
Aug 16 20:00:10 user nova-compute[72894]:     <nova:memory>512</nova:memory>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:disk>1</nova:disk>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:swap>0</nova:swap>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:10 user nova-compute[72894]:   </nova:flavor>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:owner>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:user uuid="21bae0264e7d4b53b420644daf702684">tempest-TaggedAttachmentsTest-1281191126-project-member</nova:user>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:project uuid="ebaf7d30d23f445d8b52521dcfc637e2">tempest-TaggedAttachmentsTest-1281191126</nova:project>
Aug 16 20:00:10 user nova-compute[72894]:   </nova:owner>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:10 user nova-compute[72894]:   <nova:ports>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:port uuid="d3642a60-024d-4af0-8353-7a6a9d6bb136">
Aug 16 20:00:10 user nova-compute[72894]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:00:10 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:10 user nova-compute[72894]:     <nova:port uuid="cce01aaf-4443-4dc2-8fcf-601daa33bdbc">
Aug 16 20:00:10 user nova-compute[72894]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Aug 16 20:00:10 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:10 user nova-compute[72894]:   </nova:ports>
Aug 16 20:00:10 user nova-compute[72894]: </nova:instance>
Aug 16 20:00:10 user nova-compute[72894]:  {{(pid=72894) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d98b8a8f-5b6c-43e7-ab2e-7513a76f9649 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.756s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'flavor' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:10 user nova-compute[72894]: INFO nova.compute.manager [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Attaching volume 47f9c56e-3031-491c-b65b-29e1b6f3f9c5 to /dev/vdb
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.utils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135622c-33cd-45fd-9539-83620f9f3a6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8fcd07-d41e-4e1f-bfc5-9856bb2dbffc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1cb17-2c15-46b4-b3cf-b9f3b50d36b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ae06c-0546-48a4-a612-3870374beb23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:00:10 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8048df5-b6de-4357-b30c-8a5e6c43dedf]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.utils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating existing volume attachment record: 6865031f-2426-4fb7-9786-8cd961b8b289 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23662646530663336', 'path': '/dev/sdf'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662646530663336', 'path': '/dev/sdf'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.356s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'flavor' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f2bc2-7625-4583-8715-3771235f65df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:00:10 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:10 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:00:10 user nova-compute[72894]:   <target dev="sdc" bus="scsi"/>
Aug 16 20:00:10 user nova-compute[72894]:   <serial>87c38432-16b1-4a1f-bd9f-9cb4b1794dfe</serial>
Aug 16 20:00:10 user nova-compute[72894]:   <address type="drive" controller="0" unit="2"/>
Aug 16 20:00:10 user nova-compute[72894]: </disk>
Aug 16 20:00:10 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eec496-d4ea-4e3c-908b-1cb71b2c4782]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 (non-flash)
Aug 16 20:00:10 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c6776d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:00:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[000492c9-e90c-428e-9e6c-4ee2b3a7eae1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361ec25-2f59-461f-bdec-4d3251c993e7]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c194c-c613-4049-be36-3762d6512da7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[96701e4a-df43-4b81-bdc5-859be528abd2]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[acecfccb-ce8c-4c57-89e7-6157b2412f4c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ee328-bca6-40a9-bc94-55d8870b958e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260]
Aug 16 20:00:11 user nova-compute[72894]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:11 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd341fa6-a020-4fc0-b93d-91634a44d103 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[389f30aa-a041-4b9b-86ba-639d2d06a375]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] <== disconnect_volume: return (1689ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:11 user nova-compute[72894]: WARNING nova.compute.manager [req-cb3c447c-871d-4b3d-8bf3-95e45a0133d3 req-106ade36-0e79-4022-8017-281536a9e3d3 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc for instance with vm_state active and task_state None.
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No BDM found with device name sda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] No VIF found with MAC fa:16:3e:03:77:fe, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lazy-loading 'flavor' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0d382010-0439-42be-a68d-bf434c21a8a2 tempest-VolumesAssistedSnapshotsTest-654832676 tempest-VolumesAssistedSnapshotsTest-654832676-project-admin] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.861s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ff0bbb-bddf-425d-8d08-9ec38a1552bc tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.604s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:14 user nova-compute[72894]: INFO nova.compute.manager [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Detaching volume 87c38432-16b1-4a1f-bd9f-9cb4b1794dfe
Aug 16 20:00:14 user nova-compute[72894]: INFO nova.virt.block_device [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Attempting to driver detach volume 87c38432-16b1-4a1f-bd9f-9cb4b1794dfe from mountpoint /dev/sdc
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Attempting to detach device sdc from instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:14 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:00:14 user nova-compute[72894]:   <target dev="sdc" bus="scsi"/>
Aug 16 20:00:14 user nova-compute[72894]:   <serial>87c38432-16b1-4a1f-bd9f-9cb4b1794dfe</serial>
Aug 16 20:00:14 user nova-compute[72894]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 20:00:14 user nova-compute[72894]: </disk>
Aug 16 20:00:14 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:14 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Successfully detached device sdc from instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b from the persistent domain config.
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:14 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:00:14 user nova-compute[72894]:   <target dev="sdc" bus="scsi"/>
Aug 16 20:00:14 user nova-compute[72894]:   <serial>87c38432-16b1-4a1f-bd9f-9cb4b1794dfe</serial>
Aug 16 20:00:14 user nova-compute[72894]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 20:00:14 user nova-compute[72894]: </disk>
Aug 16 20:00:14 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216014.9060388, 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:00:14 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Successfully detached device sdc from instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b from the live domain config.
Aug 16 20:00:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbQzXGZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0bdd0e-b4b2-4322-85bc-1917d5afc131]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd2bfa-a0fd-4e3f-a7fa-f41e4f2b5d07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:14 user nova-compute[72894]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe (non-flash)
Aug 16 20:00:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79903f1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe'): ({'sdf'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Removing single pathed devices sdf {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:00:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fcf7b8-4358-4771-84a4-a83ae4aeefe7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3185b79-a3e0-4bb3-b99e-5be28f1a5549]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Flushing IO for device /dev/sdf {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fd08c-8e58-4c83-aa33-d1bb5a244230]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b8aa62-d940-4d3e-b168-d87e28e5be7b]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d8d86f-4a1e-4a89-9429-598250e16bd7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc975d57-142a-48e3-b6d9-160bab60d6b6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260]
Aug 16 20:00:15 user nova-compute[72894]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c38432-16b1-4a1f-bd9f-9cb4b1794dfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[90104536-8b9e-4d85-ad00-5137b7f4810f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] <== disconnect_volume: return (369ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'flavor' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a59-4c4c-4f1e-a198-1bcf68eca595 tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.067s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:16 user nova-compute[72894]: INFO nova.compute.manager [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Terminating instance
Aug 16 20:00:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:00:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-unplugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] No waiting events found dispatching network-vif-unplugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-e62c1505-1d8d-444f-a5af-3b0dd997bf3e req-e313a936-870d-4dac-b35e-36c563056dbc service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-unplugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:00:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Creating image(s)
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Ensure instance console log exists: /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Start _get_guest_xml network_info=[{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '31e77d7b-bce4-480c-a102-d0fd645a769f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvazRHts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54ca09d8-e407-4053-8a27-e318b74211b5', 'attached_at': '', 'detached_at': '', 'volume_id': '3e06385e-3b16-447c-a1c9-1cf37346d4ba', 'serial': '3e06385e-3b16-447c-a1c9-1cf37346d4ba'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '8bd7f2f2-7e65-44b0-8c7d-800248bf773c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOdyshvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54ca09d8-e407-4053-8a27-e318b74211b5', 'attached_at': '', 'detached_at': '', 'volume_id': '57ef553d-1f6f-420d-92e1-60f69eb98b59', 'serial': '57ef553d-1f6f-420d-92e1-60f69eb98b59'}, 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '9438f251-2591-42ad-9e3d-8b1877934f18', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNJQeanI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54ca09d8-e407-4053-8a27-e318b74211b5', 'attached_at': '', 'detached_at': '', 'volume_id': '163871a6-414b-410e-9054-67b29509a445', 'serial': '163871a6-414b-410e-9054-67b29509a445'}, 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:00:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvazRHts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:17 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:17 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:17 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd3cf15-e2f2-40ea-a14b-724f7e9a8355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:17 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffcea92-49ae-4fa5-980e-27575b990fcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba] added
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1bbc44-2387-4067-9a65-7ac349aa2c26]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Instance destroyed successfully.
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lazy-loading 'resources' on Instance uuid 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-710866739',display_name='tempest-AttachSCSIVolumeTestJSON-server-710866739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-710866739',id=4,image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3OtQWKctR9iUAn1y6HNvoQE/Zs3V5z65DiqUN0wANEbFylM4lrHy8gE2lKbX/jG44dKfDUBcbL/l/GA2gn5zhXAU0u0p9llUc7nr9mWSH1zqD1h1afcZdm8ICq6IfpJw==',key_name='tempest-keypair-1795052867',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3725e09c11846bf9d7973fc87d1134a',ramdisk_id='',reservation_id='r-egemkt9q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be1c9a63-6264-4b0e-8d7b-913a1a36f1b3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1462863841',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1462863841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af7e3dd3bc84d2a9d9ad6476d3c441a',uuid=91a5c13b-ef0e-4423-a0d4-d1dce8eb091b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converting VIF {"id": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "address": "fa:16:3e:03:77:fe", "network": {"id": "b0eea357-a600-446d-a1dd-e6ecd18e9c79", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655115353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3725e09c11846bf9d7973fc87d1134a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642f6751-1a", "ovs_interfaceid": "642f6751-1a5e-4b1e-bd3b-b96a0911456d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_vif [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ecbb40-ddcf-4648-a782-c6b24f3cf214]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap642f6751-1a, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvazRHts {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:17 user nova-compute[72894]: INFO os_vif [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:77:fe,bridge_name='br-int',has_traffic_filtering=True,id=642f6751-1a5e-4b1e-bd3b-b96a0911456d,network=Network(b0eea357-a600-446d-a1dd-e6ecd18e9c79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642f6751-1a')
Aug 16 20:00:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Deleting instance files /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b_del
Aug 16 20:00:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Deletion of /opt/stack/data/nova/instances/91a5c13b-ef0e-4423-a0d4-d1dce8eb091b_del complete
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvazRHts" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3065dfb0-3b4f-4f14-8195-3439c4acb612]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvazRHts'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519fbfa-e05d-44f6-91e7-968a05abdfa1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25170b9-8b87-4d1c-9267-b61258bddc1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: INFO nova.compute.manager [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc218c-8c11-4a5e-b58d-0e41da963009]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260]
Aug 16 20:00:17 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf84d3a-e840-4587-9494-94df63454ffa]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d85a81-089b-4e67-bdd5-81d5ac1d2d1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:17 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:17 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbded50d-7e49-4700-b753-0701bcd237be]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:17 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvazRHts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26665303464326536', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665303464326536', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:18 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-a3d80345-c5e1-49a8-87cb-d0f391a89519 req-9bee8f30-5a6c-4d8a-8056-273e1df3a6bb service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-deleted-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:19 user nova-compute[72894]: INFO nova.compute.manager [req-a3d80345-c5e1-49a8-87cb-d0f391a89519 req-9bee8f30-5a6c-4d8a-8056-273e1df3a6bb service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Neutron deleted interface 642f6751-1a5e-4b1e-bd3b-b96a0911456d; detaching it from the instance and deleting it from the info cache
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-a3d80345-c5e1-49a8-87cb-d0f391a89519 req-9bee8f30-5a6c-4d8a-8056-273e1df3a6bb service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:19 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Took 1.20 seconds to deallocate network for instance.
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOdyshvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:19 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-a3d80345-c5e1-49a8-87cb-d0f391a89519 req-9bee8f30-5a6c-4d8a-8056-273e1df3a6bb service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Detach interface failed, port_id=642f6751-1a5e-4b1e-bd3b-b96a0911456d, reason: Instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b7cedc-44c8-4e9c-801c-7047543ae0be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:19 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7432fbba-8abd-4346-ae94-2712dc3c5379]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59] added
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66243df0-8be1-4593-b44c-9b2b90249a04]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e5df7-2a9e-4434-8e13-1458ade9d343]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOdyshvo {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOdyshvo" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30853709-9c69-436e-abbd-c1ec9ab0ce9a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOdyshvo'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9c9a8f-c583-4a34-8fa8-4029972d845b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e42d7-6ec4-4f6d-884c-dd148198ae11]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0348c67-ddbc-4b8c-9b0c-2a1ad1b4d9c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260]
Aug 16 20:00:19 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da95fa-a2a8-41a4-a50f-7cd9ad625e15]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] Acquiring lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] No waiting events found dispatching network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:19 user nova-compute[72894]: WARNING nova.compute.manager [req-48a97329-8f32-43d7-865a-7a90e2520662 req-07253511-e240-40e9-a55d-1ebe48589658 service nova] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Received unexpected event network-vif-plugged-642f6751-1a5e-4b1e-bd3b-b96a0911456d for instance with vm_state deleted and task_state None.
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3d3f2-71d5-4fca-9c87-bdadbc6f81f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:19 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38315d6-2efc-45ab-b843-db0392a01237]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOdyshvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:19 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Deleted allocations for instance 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b
Aug 16 20:00:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8ab02508-d785-48b1-a527-a78ae59fbece tempest-AttachSCSIVolumeTestJSON-1462863841 tempest-AttachSCSIVolumeTestJSON-1462863841-project-member] Lock "91a5c13b-ef0e-4423-a0d4-d1dce8eb091b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23034366330303235', 'path': '/dev/sdf'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034366330303235', 'path': '/dev/sdf'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNJQeanI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:20 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:20 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:20 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878c49a-2566-4a96-a263-8b968ac15d56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:20 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7098710-698a-498d-95bc-57fcb68f6ea6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445] added
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44d1fbc-3bb4-48a7-95e3-6f19444920bf]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b9c07-2b41-44fa-a2a3-e6c26deefe25]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNJQeanI {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNJQeanI" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff3a5de-3f5c-4786-84be-cc737c2bb24f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNJQeanI'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735ca10-13b5-4eb1-b53f-0cc1b5355104]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760902a-eaae-4721-8cb0-d48d77c0f9ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e431748d-2229-4a63-a56e-f6cb06ac43f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260]
Aug 16 20:00:20 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26aec6-1671-49f7-96fd-5b68c5846701]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20bd8f9-b5cb-4841-b89a-aa9fc2034eb9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ccf1d5-2269-4e6a-87dd-aa610c6fbad6]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNJQeanI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26262313530633333', 'path': '/dev/sdg'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262313530633333', 'path': '/dev/sdg'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lazy-loading 'pci_devices' on Instance uuid 54ca09d8-e407-4053-8a27-e318b74211b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:00:21 user nova-compute[72894]:   <uuid>54ca09d8-e407-4053-8a27-e318b74211b5</uuid>
Aug 16 20:00:21 user nova-compute[72894]:   <name>instance-00000007</name>
Aug 16 20:00:21 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:00:21 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:00:21 user nova-compute[72894]:   <metadata>
Aug 16 20:00:21 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:21 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:name>tempest-device-tagging-server-408212777</nova:name>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:00:17</nova:creationTime>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:00:21 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:21 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:owner>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:user uuid="10f14678cec34119a408b36cb99f7827">tempest-TaggedBootDevicesTest-166088539-project-member</nova:user>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:project uuid="3e523c246d424c31ba852e5234f416b5">tempest-TaggedBootDevicesTest-166088539</nova:project>
Aug 16 20:00:21 user nova-compute[72894]:       </nova:owner>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:21 user nova-compute[72894]:       <nova:ports>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="3b0566f7-949c-414d-b1ff-91990d9ea863">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="bef2f44a-5979-4676-b04b-985c6b282de8">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="25145c72-85a5-4565-9880-593db50b9a9d">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="f91b4d66-eb76-4a91-a1f5-0968b3d40615">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="d74bdb23-3d85-4fc3-bcba-cedb58966818">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:         <nova:port uuid="247c5bea-e271-4bab-8241-b1bf4a121f5b">
Aug 16 20:00:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 20:00:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:21 user nova-compute[72894]:       </nova:ports>
Aug 16 20:00:21 user nova-compute[72894]:     </nova:instance>
Aug 16 20:00:21 user nova-compute[72894]:   </metadata>
Aug 16 20:00:21 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:00:21 user nova-compute[72894]:     <system>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="serial">54ca09d8-e407-4053-8a27-e318b74211b5</entry>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="uuid">54ca09d8-e407-4053-8a27-e318b74211b5</entry>
Aug 16 20:00:21 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:00:21 user nova-compute[72894]:     </system>
Aug 16 20:00:21 user nova-compute[72894]:   </sysinfo>
Aug 16 20:00:21 user nova-compute[72894]:   <os>
Aug 16 20:00:21 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:00:21 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:00:21 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:00:21 user nova-compute[72894]:   </os>
Aug 16 20:00:21 user nova-compute[72894]:   <features>
Aug 16 20:00:21 user nova-compute[72894]:     <acpi/>
Aug 16 20:00:21 user nova-compute[72894]:     <apic/>
Aug 16 20:00:21 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:00:21 user nova-compute[72894]:   </features>
Aug 16 20:00:21 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:00:21 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:00:21 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:00:21 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:00:21 user nova-compute[72894]:   </clock>
Aug 16 20:00:21 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:00:21 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:00:21 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:00:21 user nova-compute[72894]:   </cpu>
Aug 16 20:00:21 user nova-compute[72894]:   <devices>
Aug 16 20:00:21 user nova-compute[72894]:     <disk type="file" device="cdrom">
Aug 16 20:00:21 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 20:00:21 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/disk.config"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="hda" bus="ide"/>
Aug 16 20:00:21 user nova-compute[72894]:     </disk>
Aug 16 20:00:21 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:00:21 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:21 user nova-compute[72894]:       <source dev="/dev/sde"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <serial>3e06385e-3b16-447c-a1c9-1cf37346d4ba</serial>
Aug 16 20:00:21 user nova-compute[72894]:     </disk>
Aug 16 20:00:21 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:00:21 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:21 user nova-compute[72894]:       <source dev="/dev/sdf"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <serial>57ef553d-1f6f-420d-92e1-60f69eb98b59</serial>
Aug 16 20:00:21 user nova-compute[72894]:     </disk>
Aug 16 20:00:21 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:00:21 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:21 user nova-compute[72894]:       <source dev="/dev/sdg"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="vdc" bus="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <serial>163871a6-414b-410e-9054-67b29509a445</serial>
Aug 16 20:00:21 user nova-compute[72894]:     </disk>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:22:cb:93"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tap3b0566f7-94"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:f0:6e:45"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tapbef2f44a-59"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:30:cf:2a"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tape9ed96d7-56"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:11:4f:2c"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tap25145c72-85"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:f8:4a:5d"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tapf91b4d66-eb"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:6f:df:7d"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tapd74bdb23-3d"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:21 user nova-compute[72894]:       <mac address="fa:16:3e:73:15:7b"/>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:21 user nova-compute[72894]:       <target dev="tap247c5bea-e2"/>
Aug 16 20:00:21 user nova-compute[72894]:     </interface>
Aug 16 20:00:21 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:00:21 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/console.log" append="off"/>
Aug 16 20:00:21 user nova-compute[72894]:     </serial>
Aug 16 20:00:21 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:00:21 user nova-compute[72894]:     <video>
Aug 16 20:00:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:21 user nova-compute[72894]:     </video>
Aug 16 20:00:21 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:00:21 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:00:21 user nova-compute[72894]:     </rng>
Aug 16 20:00:21 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:00:21 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:00:21 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:00:21 user nova-compute[72894]:     </memballoon>
Aug 16 20:00:21 user nova-compute[72894]:   </devices>
Aug 16 20:00:21 user nova-compute[72894]: </domain>
Aug 16 20:00:21 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b0566f7-94, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b0566f7-94, col_values=(('external_ids', {'iface-id': '3b0566f7-949c-414d-b1ff-91990d9ea863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:cb:93', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94')
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef2f44a-59, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbef2f44a-59, col_values=(('external_ids', {'iface-id': 'bef2f44a-5979-4676-b04b-985c6b282de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:6e:45', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59')
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9ed96d7-56, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9ed96d7-56, col_values=(('external_ids', {'iface-id': 'e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:cf:2a', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56')
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25145c72-85, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25145c72-85, col_values=(('external_ids', {'iface-id': '25145c72-85a5-4565-9880-593db50b9a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:4f:2c', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85')
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91b4d66-eb, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf91b4d66-eb, col_values=(('external_ids', {'iface-id': 'f91b4d66-eb76-4a91-a1f5-0968b3d40615', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4a:5d', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb')
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd74bdb23-3d, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd74bdb23-3d, col_values=(('external_ids', {'iface-id': 'd74bdb23-3d85-4fc3-bcba-cedb58966818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:df:7d', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d')
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap247c5bea-e2, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap247c5bea-e2, col_values=(('external_ids', {'iface-id': '247c5bea-e271-4bab-8241-b1bf4a121f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:15:7b', 'vm-uuid': '54ca09d8-e407-4053-8a27-e318b74211b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:22 user nova-compute[72894]: INFO os_vif [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2')
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] No BDM found with device name hda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] No VIF found with MAC fa:16:3e:22:cb:93, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] No VIF found with MAC fa:16:3e:f8:4a:5d, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Using config drive
Aug 16 20:00:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Creating config drive at /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/disk.config
Aug 16 20:00:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp764cqujc {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp764cqujc" returned: 0 in 0.053s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXmIfRgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:24 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:24 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:24 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad3bfa-de98-41cf-801e-84d9ac82e757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:24 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c17722-2c6f-4594-bf7e-9b3ae4369212]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5] added
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:24 user nova-compute[72894]: WARNING nova.compute.manager [req-4ab68052-304a-4eb6-bb17-6bb454aa57b3 req-48dd842b-318d-4077-af3c-b9bcb9e4b727 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 for instance with vm_state building and task_state spawning.
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9889165b-6080-4147-ad3c-1ffb98cbc045]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d8376-4fa6-4151-a6b8-c7e566faee3e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXmIfRgF {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXmIfRgF" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56985e-2492-4277-85aa-229f5d5cb68c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXmIfRgF'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[45954893-44f8-4971-9332-30a748933ebc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77950581-9d8f-401e-b3ef-3f8ca034efe3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[461016bf-7b2a-45fe-baa8-bd11d365d8ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260]
Aug 16 20:00:24 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab3e674-bc2e-417d-a7e4-02fd8320438d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced327f-4375-4489-92b1-ba5936d64835]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[09513826-a9a1-422c-b630-89eaca1b0a1e]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXmIfRgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:24 user nova-compute[72894]: WARNING nova.compute.manager [req-01e92200-2c95-4e9f-b9a3-e7deceb7b6b2 req-d10acc7a-3080-4a6a-b3b8-c0eae8ff269a service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a for instance with vm_state building and task_state spawning.
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:25 user nova-compute[72894]: WARNING nova.compute.manager [req-d044d26f-569e-4f03-8919-483b9798fb7b req-ceb6d665-dbab-4b98-ad96-e88b8caa85d5 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d for instance with vm_state building and task_state spawning.
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26237616563343739', 'path': '/dev/sdh'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616563343739', 'path': '/dev/sdh'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'flavor' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:00:25 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:25 user nova-compute[72894]:   <source dev="/dev/sdh"/>
Aug 16 20:00:25 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:25 user nova-compute[72894]:   <serial>47f9c56e-3031-491c-b65b-29e1b6f3f9c5</serial>
Aug 16 20:00:25 user nova-compute[72894]: </disk>
Aug 16 20:00:25 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:26 user nova-compute[72894]: WARNING nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 for instance with vm_state building and task_state spawning.
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:26 user nova-compute[72894]: WARNING nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 for instance with vm_state building and task_state spawning.
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:26 user nova-compute[72894]: WARNING nova.compute.manager [req-d26ccac2-564f-4e03-a2fd-69befde4d199 req-2adaf288-132f-4186-8d52-c9ca775acb78 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 for instance with vm_state building and task_state spawning.
Aug 16 20:00:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No BDM found with device name hda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] No VIF found with MAC fa:16:3e:eb:a7:2d, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-364fcbc6-65f1-408d-b8a6-d4065f5e9869 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.249s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:26 user nova-compute[72894]: WARNING nova.compute.manager [req-dbc7d905-8a48-417d-9c17-58282ce1eeb5 req-4047c780-e237-4e6c-b26e-1313066b5dfe service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:27 user nova-compute[72894]: WARNING nova.compute.manager [req-44b9a89e-e2db-4e0e-9940-4741a0895978 req-2938b965-b126-44a2-a4ca-e3982e1820f6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b for instance with vm_state building and task_state spawning.
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Detaching volume 47f9c56e-3031-491c-b65b-29e1b6f3f9c5
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.virt.block_device [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Attempting to driver detach volume 47f9c56e-3031-491c-b65b-29e1b6f3f9c5 from mountpoint /dev/vdb
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Attempting to detach device vdb from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:28 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:28 user nova-compute[72894]:   <source dev="/dev/sdh"/>
Aug 16 20:00:28 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:28 user nova-compute[72894]:   <serial>47f9c56e-3031-491c-b65b-29e1b6f3f9c5</serial>
Aug 16 20:00:28 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:00:28 user nova-compute[72894]: </disk>
Aug 16 20:00:28 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully detached device vdb from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the persistent domain config.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:00:28 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:28 user nova-compute[72894]:   <source dev="/dev/sdh"/>
Aug 16 20:00:28 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:00:28 user nova-compute[72894]:   <serial>47f9c56e-3031-491c-b65b-29e1b6f3f9c5</serial>
Aug 16 20:00:28 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:00:28 user nova-compute[72894]: </disk>
Aug 16 20:00:28 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216028.7422986, 54ca09d8-e407-4053-8a27-e318b74211b5 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] VM Resumed (Lifecycle Event)
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance spawned successfully.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.claims [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Claim successful on node user
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216028.7496989, 54ca09d8-e407-4053-8a27-e318b74211b5 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] VM Started (Lifecycle Event)
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Took 11.39 seconds to spawn the instance on the hypervisor.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216028.9273136, 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:00:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully detached device vdb from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the live domain config.
Aug 16 20:00:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXmIfRgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[876527ee-e87f-4877-8a6e-e09273e7e90e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Took 85.78 seconds to build instance.
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cee4f4-bb58-45f7-836d-f48dfa7c86ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79904c1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5'): ({'sdh'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Removing single pathed devices sdh {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fb68b143-3989-4c0b-baff-858ab3d67672 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 85.904s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47b8c2-4055-4fe2-9fd4-ea1374274c94]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1f26b-3dc0-4002-8ce0-bf19dacdc50c]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Flushing IO for device /dev/sdh {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72ccea-46db-424d-9b8e-c48dc8739121]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb055d21-e115-43b4-8831-d84ac0831208]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] SCSI volumes sdh have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0614b1-b4a4-4af3-84e9-18e6e3230f58]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94120aee-5ab9-4112-8ec8-2e47af9d8ef1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260]
Aug 16 20:00:29 user nova-compute[72894]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f9c56e-3031-491c-b65b-29e1b6f3f9c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cfb820-30e9-4b14-aa31-50d453ea4eef]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] <== disconnect_volume: return (357ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:00:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.policy [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c9bdeca6ea84622835b26c7565f148c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0853a75dd30c499288bb5e848f038580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:00:29 user nova-compute[72894]: INFO nova.virt.block_device [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Booting with blank volume at /dev/vda
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'flavor' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Successfully created port: 721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a833f80c-e111-4e9f-afeb-74b87151e32b tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.927s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-cce01aaf-4443-4dc2-8fcf-601daa33bdbc" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-cce01aaf-4443-4dc2-8fcf-601daa33bdbc" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'flavor' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface> {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface> {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Attempting to detach device tapcce01aaf-44 from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] detach device xml: <interface type="ethernet">
Aug 16 20:00:30 user nova-compute[72894]:   <mac address="fa:16:3e:fe:89:2b"/>
Aug 16 20:00:30 user nova-compute[72894]:   <model type="virtio"/>
Aug 16 20:00:30 user nova-compute[72894]:   <mtu size="1442"/>
Aug 16 20:00:30 user nova-compute[72894]:   <target dev="tapcce01aaf-44"/>
Aug 16 20:00:30 user nova-compute[72894]: </interface>
Aug 16 20:00:30 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface> {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 16 20:00:30 user nova-compute[72894]:   <name>instance-00000006</name>
Aug 16 20:00:30 user nova-compute[72894]:   <uuid>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</uuid>
Aug 16 20:00:30 user nova-compute[72894]:   <metadata>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:30 user nova-compute[72894]:   <nova:package version="0.0.0"/>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:name>tempest-device-tagging-server-2063957319</nova:name>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:creationTime>2023-08-16 20:00:10</nova:creationTime>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:flavor name="m1.tiny">
Aug 16 20:00:30 user nova-compute[72894]:     <nova:memory>512</nova:memory>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:disk>1</nova:disk>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:swap>0</nova:swap>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:30 user nova-compute[72894]:   </nova:flavor>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:owner>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:user uuid="21bae0264e7d4b53b420644daf702684">tempest-TaggedAttachmentsTest-1281191126-project-member</nova:user>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:project uuid="ebaf7d30d23f445d8b52521dcfc637e2">tempest-TaggedAttachmentsTest-1281191126</nova:project>
Aug 16 20:00:30 user nova-compute[72894]:   </nova:owner>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:30 user nova-compute[72894]:   <nova:ports>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:port uuid="d3642a60-024d-4af0-8353-7a6a9d6bb136">
Aug 16 20:00:30 user nova-compute[72894]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:00:30 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:30 user nova-compute[72894]:     <nova:port uuid="cce01aaf-4443-4dc2-8fcf-601daa33bdbc">
Aug 16 20:00:30 user nova-compute[72894]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Aug 16 20:00:30 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:30 user nova-compute[72894]:   </nova:ports>
Aug 16 20:00:30 user nova-compute[72894]: </nova:instance>
Aug 16 20:00:30 user nova-compute[72894]:   </metadata>
Aug 16 20:00:30 user nova-compute[72894]:   <memory unit='KiB'>524288</memory>
Aug 16 20:00:30 user nova-compute[72894]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 20:00:30 user nova-compute[72894]:   <vcpu placement='static'>1</vcpu>
Aug 16 20:00:30 user nova-compute[72894]:   <resource>
Aug 16 20:00:30 user nova-compute[72894]:     <partition>/machine</partition>
Aug 16 20:00:30 user nova-compute[72894]:   </resource>
Aug 16 20:00:30 user nova-compute[72894]:   <sysinfo type='smbios'>
Aug 16 20:00:30 user nova-compute[72894]:     <system>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='version'>0.0.0</entry>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='serial'>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='uuid'>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 20:00:30 user nova-compute[72894]:       <entry name='family'>Virtual Machine</entry>
Aug 16 20:00:30 user nova-compute[72894]:     </system>
Aug 16 20:00:30 user nova-compute[72894]:   </sysinfo>
Aug 16 20:00:30 user nova-compute[72894]:   <os>
Aug 16 20:00:30 user nova-compute[72894]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 20:00:30 user nova-compute[72894]:     <boot dev='hd'/>
Aug 16 20:00:30 user nova-compute[72894]:     <smbios mode='sysinfo'/>
Aug 16 20:00:30 user nova-compute[72894]:   </os>
Aug 16 20:00:30 user nova-compute[72894]:   <features>
Aug 16 20:00:30 user nova-compute[72894]:     <acpi/>
Aug 16 20:00:30 user nova-compute[72894]:     <apic/>
Aug 16 20:00:30 user nova-compute[72894]:     <vmcoreinfo state='on'/>
Aug 16 20:00:30 user nova-compute[72894]:   </features>
Aug 16 20:00:30 user nova-compute[72894]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 20:00:30 user nova-compute[72894]:     <model fallback='forbid'>Nehalem</model>
Aug 16 20:00:30 user nova-compute[72894]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 20:00:30 user nova-compute[72894]:     <feature policy='require' name='vme'/>
Aug 16 20:00:30 user nova-compute[72894]:     <feature policy='require' name='x2apic'/>
Aug 16 20:00:30 user nova-compute[72894]:     <feature policy='require' name='hypervisor'/>
Aug 16 20:00:30 user nova-compute[72894]:   </cpu>
Aug 16 20:00:30 user nova-compute[72894]:   <clock offset='utc'>
Aug 16 20:00:30 user nova-compute[72894]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 20:00:30 user nova-compute[72894]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 20:00:30 user nova-compute[72894]:     <timer name='hpet' present='no'/>
Aug 16 20:00:30 user nova-compute[72894]:   </clock>
Aug 16 20:00:30 user nova-compute[72894]:   <on_poweroff>destroy</on_poweroff>
Aug 16 20:00:30 user nova-compute[72894]:   <on_reboot>restart</on_reboot>
Aug 16 20:00:30 user nova-compute[72894]:   <on_crash>destroy</on_crash>
Aug 16 20:00:30 user nova-compute[72894]:   <devices>
Aug 16 20:00:30 user nova-compute[72894]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 20:00:30 user nova-compute[72894]:     <disk type='file' device='disk'>
Aug 16 20:00:30 user nova-compute[72894]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 20:00:30 user nova-compute[72894]:       <source file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk' index='2'/>
Aug 16 20:00:30 user nova-compute[72894]:       <backingStore type='file' index='3'>
Aug 16 20:00:30 user nova-compute[72894]:         <format type='raw'/>
Aug 16 20:00:30 user nova-compute[72894]:         <source file='/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f'/>
Aug 16 20:00:30 user nova-compute[72894]:         <backingStore/>
Aug 16 20:00:30 user nova-compute[72894]:       </backingStore>
Aug 16 20:00:30 user nova-compute[72894]:       <target dev='vda' bus='virtio'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='virtio-disk0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </disk>
Aug 16 20:00:30 user nova-compute[72894]:     <disk type='file' device='cdrom'>
Aug 16 20:00:30 user nova-compute[72894]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 20:00:30 user nova-compute[72894]:       <source file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config' index='1'/>
Aug 16 20:00:30 user nova-compute[72894]:       <backingStore/>
Aug 16 20:00:30 user nova-compute[72894]:       <target dev='hda' bus='ide'/>
Aug 16 20:00:30 user nova-compute[72894]:       <readonly/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='ide0-0-0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </disk>
Aug 16 20:00:30 user nova-compute[72894]:     <controller type='usb' index='0' model='none'>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='usb'/>
Aug 16 20:00:30 user nova-compute[72894]:     </controller>
Aug 16 20:00:30 user nova-compute[72894]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='pci.0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </controller>
Aug 16 20:00:30 user nova-compute[72894]:     <controller type='ide' index='0'>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='ide'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 20:00:30 user nova-compute[72894]:     </controller>
Aug 16 20:00:30 user nova-compute[72894]:     <interface type='ethernet'>
Aug 16 20:00:30 user nova-compute[72894]:       <mac address='fa:16:3e:eb:a7:2d'/>
Aug 16 20:00:30 user nova-compute[72894]:       <target dev='tapd3642a60-02'/>
Aug 16 20:00:30 user nova-compute[72894]:       <model type='virtio'/>
Aug 16 20:00:30 user nova-compute[72894]:       <mtu size='1442'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='net0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </interface>
Aug 16 20:00:30 user nova-compute[72894]:     <interface type='ethernet'>
Aug 16 20:00:30 user nova-compute[72894]:       <mac address='fa:16:3e:fe:89:2b'/>
Aug 16 20:00:30 user nova-compute[72894]:       <target dev='tapcce01aaf-44'/>
Aug 16 20:00:30 user nova-compute[72894]:       <model type='virtio'/>
Aug 16 20:00:30 user nova-compute[72894]:       <mtu size='1442'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='net1'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </interface>
Aug 16 20:00:30 user nova-compute[72894]:     <serial type='pty'>
Aug 16 20:00:30 user nova-compute[72894]:       <source path='/dev/pts/5'/>
Aug 16 20:00:30 user nova-compute[72894]:       <log file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log' append='off'/>
Aug 16 20:00:30 user nova-compute[72894]:       <target type='isa-serial' port='0'>
Aug 16 20:00:30 user nova-compute[72894]:         <model name='isa-serial'/>
Aug 16 20:00:30 user nova-compute[72894]:       </target>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='serial0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </serial>
Aug 16 20:00:30 user nova-compute[72894]:     <console type='pty' tty='/dev/pts/5'>
Aug 16 20:00:30 user nova-compute[72894]:       <source path='/dev/pts/5'/>
Aug 16 20:00:30 user nova-compute[72894]:       <log file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log' append='off'/>
Aug 16 20:00:30 user nova-compute[72894]:       <target type='serial' port='0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='serial0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </console>
Aug 16 20:00:30 user nova-compute[72894]:     <input type='mouse' bus='ps2'>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='input0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </input>
Aug 16 20:00:30 user nova-compute[72894]:     <input type='keyboard' bus='ps2'>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='input1'/>
Aug 16 20:00:30 user nova-compute[72894]:     </input>
Aug 16 20:00:30 user nova-compute[72894]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 16 20:00:30 user nova-compute[72894]:       <listen type='address' address='0.0.0.0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </graphics>
Aug 16 20:00:30 user nova-compute[72894]:     <audio id='1' type='none'/>
Aug 16 20:00:30 user nova-compute[72894]:     <video>
Aug 16 20:00:30 user nova-compute[72894]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='video0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </video>
Aug 16 20:00:30 user nova-compute[72894]:     <memballoon model='virtio'>
Aug 16 20:00:30 user nova-compute[72894]:       <stats period='10'/>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='balloon0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </memballoon>
Aug 16 20:00:30 user nova-compute[72894]:     <rng model='virtio'>
Aug 16 20:00:30 user nova-compute[72894]:       <backend model='random'>/dev/urandom</backend>
Aug 16 20:00:30 user nova-compute[72894]:       <alias name='rng0'/>
Aug 16 20:00:30 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 20:00:30 user nova-compute[72894]:     </rng>
Aug 16 20:00:30 user nova-compute[72894]:   </devices>
Aug 16 20:00:30 user nova-compute[72894]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 20:00:30 user nova-compute[72894]:     <label>libvirt-9e9e5bd9-2ca4-49ef-a09a-927cf569be66</label>
Aug 16 20:00:30 user nova-compute[72894]:     <imagelabel>libvirt-9e9e5bd9-2ca4-49ef-a09a-927cf569be66</imagelabel>
Aug 16 20:00:30 user nova-compute[72894]:   </seclabel>
Aug 16 20:00:30 user nova-compute[72894]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 20:00:30 user nova-compute[72894]:     <label>+64055:+108</label>
Aug 16 20:00:30 user nova-compute[72894]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 20:00:30 user nova-compute[72894]:   </seclabel>
Aug 16 20:00:30 user nova-compute[72894]: </domain>
Aug 16 20:00:30 user nova-compute[72894]:  {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 20:00:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully detached device tapcce01aaf-44 from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the persistent domain config.
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] (1/8): Attempting to detach device tapcce01aaf-44 with device alias net1 from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:00:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] detach device xml: <interface type="ethernet">
Aug 16 20:00:30 user nova-compute[72894]:   <mac address="fa:16:3e:fe:89:2b"/>
Aug 16 20:00:30 user nova-compute[72894]:   <model type="virtio"/>
Aug 16 20:00:30 user nova-compute[72894]:   <mtu size="1442"/>
Aug 16 20:00:30 user nova-compute[72894]:   <target dev="tapcce01aaf-44"/>
Aug 16 20:00:30 user nova-compute[72894]: </interface>
Aug 16 20:00:30 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216031.2941344, 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Start waiting for the detach event from libvirt for device tapcce01aaf-44 with device alias net1 for instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface> {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fe:89:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapcce01aaf-44"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 16 20:00:31 user nova-compute[72894]:   <name>instance-00000006</name>
Aug 16 20:00:31 user nova-compute[72894]:   <uuid>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</uuid>
Aug 16 20:00:31 user nova-compute[72894]:   <metadata>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:31 user nova-compute[72894]:   <nova:package version="0.0.0"/>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:name>tempest-device-tagging-server-2063957319</nova:name>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:creationTime>2023-08-16 20:00:10</nova:creationTime>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:flavor name="m1.tiny">
Aug 16 20:00:31 user nova-compute[72894]:     <nova:memory>512</nova:memory>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:disk>1</nova:disk>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:swap>0</nova:swap>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:flavor>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:owner>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:user uuid="21bae0264e7d4b53b420644daf702684">tempest-TaggedAttachmentsTest-1281191126-project-member</nova:user>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:project uuid="ebaf7d30d23f445d8b52521dcfc637e2">tempest-TaggedAttachmentsTest-1281191126</nova:project>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:owner>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:ports>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:port uuid="d3642a60-024d-4af0-8353-7a6a9d6bb136">
Aug 16 20:00:31 user nova-compute[72894]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:00:31 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:port uuid="cce01aaf-4443-4dc2-8fcf-601daa33bdbc">
Aug 16 20:00:31 user nova-compute[72894]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Aug 16 20:00:31 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:ports>
Aug 16 20:00:31 user nova-compute[72894]: </nova:instance>
Aug 16 20:00:31 user nova-compute[72894]:   </metadata>
Aug 16 20:00:31 user nova-compute[72894]:   <memory unit='KiB'>524288</memory>
Aug 16 20:00:31 user nova-compute[72894]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 20:00:31 user nova-compute[72894]:   <vcpu placement='static'>1</vcpu>
Aug 16 20:00:31 user nova-compute[72894]:   <resource>
Aug 16 20:00:31 user nova-compute[72894]:     <partition>/machine</partition>
Aug 16 20:00:31 user nova-compute[72894]:   </resource>
Aug 16 20:00:31 user nova-compute[72894]:   <sysinfo type='smbios'>
Aug 16 20:00:31 user nova-compute[72894]:     <system>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='version'>0.0.0</entry>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='serial'>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='uuid'>9e9e5bd9-2ca4-49ef-a09a-927cf569be66</entry>
Aug 16 20:00:31 user nova-compute[72894]:       <entry name='family'>Virtual Machine</entry>
Aug 16 20:00:31 user nova-compute[72894]:     </system>
Aug 16 20:00:31 user nova-compute[72894]:   </sysinfo>
Aug 16 20:00:31 user nova-compute[72894]:   <os>
Aug 16 20:00:31 user nova-compute[72894]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 20:00:31 user nova-compute[72894]:     <boot dev='hd'/>
Aug 16 20:00:31 user nova-compute[72894]:     <smbios mode='sysinfo'/>
Aug 16 20:00:31 user nova-compute[72894]:   </os>
Aug 16 20:00:31 user nova-compute[72894]:   <features>
Aug 16 20:00:31 user nova-compute[72894]:     <acpi/>
Aug 16 20:00:31 user nova-compute[72894]:     <apic/>
Aug 16 20:00:31 user nova-compute[72894]:     <vmcoreinfo state='on'/>
Aug 16 20:00:31 user nova-compute[72894]:   </features>
Aug 16 20:00:31 user nova-compute[72894]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 20:00:31 user nova-compute[72894]:     <model fallback='forbid'>Nehalem</model>
Aug 16 20:00:31 user nova-compute[72894]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 20:00:31 user nova-compute[72894]:     <feature policy='require' name='vme'/>
Aug 16 20:00:31 user nova-compute[72894]:     <feature policy='require' name='x2apic'/>
Aug 16 20:00:31 user nova-compute[72894]:     <feature policy='require' name='hypervisor'/>
Aug 16 20:00:31 user nova-compute[72894]:   </cpu>
Aug 16 20:00:31 user nova-compute[72894]:   <clock offset='utc'>
Aug 16 20:00:31 user nova-compute[72894]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 20:00:31 user nova-compute[72894]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 20:00:31 user nova-compute[72894]:     <timer name='hpet' present='no'/>
Aug 16 20:00:31 user nova-compute[72894]:   </clock>
Aug 16 20:00:31 user nova-compute[72894]:   <on_poweroff>destroy</on_poweroff>
Aug 16 20:00:31 user nova-compute[72894]:   <on_reboot>restart</on_reboot>
Aug 16 20:00:31 user nova-compute[72894]:   <on_crash>destroy</on_crash>
Aug 16 20:00:31 user nova-compute[72894]:   <devices>
Aug 16 20:00:31 user nova-compute[72894]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 20:00:31 user nova-compute[72894]:     <disk type='file' device='disk'>
Aug 16 20:00:31 user nova-compute[72894]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 20:00:31 user nova-compute[72894]:       <source file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk' index='2'/>
Aug 16 20:00:31 user nova-compute[72894]:       <backingStore type='file' index='3'>
Aug 16 20:00:31 user nova-compute[72894]:         <format type='raw'/>
Aug 16 20:00:31 user nova-compute[72894]:         <source file='/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f'/>
Aug 16 20:00:31 user nova-compute[72894]:         <backingStore/>
Aug 16 20:00:31 user nova-compute[72894]:       </backingStore>
Aug 16 20:00:31 user nova-compute[72894]:       <target dev='vda' bus='virtio'/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='virtio-disk0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </disk>
Aug 16 20:00:31 user nova-compute[72894]:     <disk type='file' device='cdrom'>
Aug 16 20:00:31 user nova-compute[72894]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 20:00:31 user nova-compute[72894]:       <source file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk.config' index='1'/>
Aug 16 20:00:31 user nova-compute[72894]:       <backingStore/>
Aug 16 20:00:31 user nova-compute[72894]:       <target dev='hda' bus='ide'/>
Aug 16 20:00:31 user nova-compute[72894]:       <readonly/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='ide0-0-0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </disk>
Aug 16 20:00:31 user nova-compute[72894]:     <controller type='usb' index='0' model='none'>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='usb'/>
Aug 16 20:00:31 user nova-compute[72894]:     </controller>
Aug 16 20:00:31 user nova-compute[72894]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='pci.0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </controller>
Aug 16 20:00:31 user nova-compute[72894]:     <controller type='ide' index='0'>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='ide'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 20:00:31 user nova-compute[72894]:     </controller>
Aug 16 20:00:31 user nova-compute[72894]:     <interface type='ethernet'>
Aug 16 20:00:31 user nova-compute[72894]:       <mac address='fa:16:3e:eb:a7:2d'/>
Aug 16 20:00:31 user nova-compute[72894]:       <target dev='tapd3642a60-02'/>
Aug 16 20:00:31 user nova-compute[72894]:       <model type='virtio'/>
Aug 16 20:00:31 user nova-compute[72894]:       <mtu size='1442'/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='net0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </interface>
Aug 16 20:00:31 user nova-compute[72894]:     <serial type='pty'>
Aug 16 20:00:31 user nova-compute[72894]:       <source path='/dev/pts/5'/>
Aug 16 20:00:31 user nova-compute[72894]:       <log file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log' append='off'/>
Aug 16 20:00:31 user nova-compute[72894]:       <target type='isa-serial' port='0'>
Aug 16 20:00:31 user nova-compute[72894]:         <model name='isa-serial'/>
Aug 16 20:00:31 user nova-compute[72894]:       </target>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='serial0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </serial>
Aug 16 20:00:31 user nova-compute[72894]:     <console type='pty' tty='/dev/pts/5'>
Aug 16 20:00:31 user nova-compute[72894]:       <source path='/dev/pts/5'/>
Aug 16 20:00:31 user nova-compute[72894]:       <log file='/opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/console.log' append='off'/>
Aug 16 20:00:31 user nova-compute[72894]:       <target type='serial' port='0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='serial0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </console>
Aug 16 20:00:31 user nova-compute[72894]:     <input type='mouse' bus='ps2'>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='input0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </input>
Aug 16 20:00:31 user nova-compute[72894]:     <input type='keyboard' bus='ps2'>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='input1'/>
Aug 16 20:00:31 user nova-compute[72894]:     </input>
Aug 16 20:00:31 user nova-compute[72894]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 16 20:00:31 user nova-compute[72894]:       <listen type='address' address='0.0.0.0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </graphics>
Aug 16 20:00:31 user nova-compute[72894]:     <audio id='1' type='none'/>
Aug 16 20:00:31 user nova-compute[72894]:     <video>
Aug 16 20:00:31 user nova-compute[72894]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='video0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </video>
Aug 16 20:00:31 user nova-compute[72894]:     <memballoon model='virtio'>
Aug 16 20:00:31 user nova-compute[72894]:       <stats period='10'/>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='balloon0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </memballoon>
Aug 16 20:00:31 user nova-compute[72894]:     <rng model='virtio'>
Aug 16 20:00:31 user nova-compute[72894]:       <backend model='random'>/dev/urandom</backend>
Aug 16 20:00:31 user nova-compute[72894]:       <alias name='rng0'/>
Aug 16 20:00:31 user nova-compute[72894]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 20:00:31 user nova-compute[72894]:     </rng>
Aug 16 20:00:31 user nova-compute[72894]:   </devices>
Aug 16 20:00:31 user nova-compute[72894]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 20:00:31 user nova-compute[72894]:     <label>libvirt-9e9e5bd9-2ca4-49ef-a09a-927cf569be66</label>
Aug 16 20:00:31 user nova-compute[72894]:     <imagelabel>libvirt-9e9e5bd9-2ca4-49ef-a09a-927cf569be66</imagelabel>
Aug 16 20:00:31 user nova-compute[72894]:   </seclabel>
Aug 16 20:00:31 user nova-compute[72894]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 20:00:31 user nova-compute[72894]:     <label>+64055:+108</label>
Aug 16 20:00:31 user nova-compute[72894]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 20:00:31 user nova-compute[72894]:   </seclabel>
Aug 16 20:00:31 user nova-compute[72894]: </domain>
Aug 16 20:00:31 user nova-compute[72894]:  {{(pid=72894) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 20:00:31 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully detached device tapcce01aaf-44 from instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 from the live domain config.
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "address": "fa:16:3e:fe:89:2b", "network": {"id": "3bd69957-4284-43c5-b779-70ccae80c133", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1780301444", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce01aaf-44", "ovs_interfaceid": "cce01aaf-4443-4dc2-8fcf-601daa33bdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG os_vif [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcce01aaf-44, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Successfully updated port: 721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:00:31 user nova-compute[72894]: INFO os_vif [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:89:2b,bridge_name='br-int',has_traffic_filtering=True,id=cce01aaf-4443-4dc2-8fcf-601daa33bdbc,network=Network(3bd69957-4284-43c5-b779-70ccae80c133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce01aaf-44')
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:31 user nova-compute[72894]:   <nova:package version="0.0.0"/>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:name>tempest-device-tagging-server-2063957319</nova:name>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:creationTime>2023-08-16 20:00:31</nova:creationTime>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:flavor name="m1.tiny">
Aug 16 20:00:31 user nova-compute[72894]:     <nova:memory>512</nova:memory>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:disk>1</nova:disk>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:swap>0</nova:swap>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:flavor>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:owner>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:user uuid="21bae0264e7d4b53b420644daf702684">tempest-TaggedAttachmentsTest-1281191126-project-member</nova:user>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:project uuid="ebaf7d30d23f445d8b52521dcfc637e2">tempest-TaggedAttachmentsTest-1281191126</nova:project>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:owner>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:31 user nova-compute[72894]:   <nova:ports>
Aug 16 20:00:31 user nova-compute[72894]:     <nova:port uuid="d3642a60-024d-4af0-8353-7a6a9d6bb136">
Aug 16 20:00:31 user nova-compute[72894]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:00:31 user nova-compute[72894]:     </nova:port>
Aug 16 20:00:31 user nova-compute[72894]:   </nova:ports>
Aug 16 20:00:31 user nova-compute[72894]: </nova:instance>
Aug 16 20:00:31 user nova-compute[72894]:  {{(pid=72894) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-changed-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Refreshing instance network info cache due to event network-changed-721c25e7-589b-4efc-9922-305a60a69af1. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.network.neutron [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Refreshing network info cache for port 721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-unplugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-unplugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:31 user nova-compute[72894]: WARNING nova.compute.manager [req-5060020b-0797-471e-8911-f26f5e9a940c req-91a69d47-6fd5-48aa-a57c-565d68112b71 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-unplugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc for instance with vm_state active and task_state None.
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:31 user nova-compute[72894]: DEBUG nova.network.neutron [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-af25a35d-176b-4862-a142-132690c86f37 req-cd37740d-6d9e-4a3f-9535-c2da0101a9db service nova] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquired lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216017.6644685, 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:00:32 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] VM Stopped (Lifecycle Event)
Aug 16 20:00:32 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:32 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7629MB free_disk=24.675369262695312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9659ee93-7b70-421d-8c6c-10260f091b54 None None] [instance: 91a5c13b-ef0e-4423-a0d4-d1dce8eb091b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance network_info: |[{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 8221cae3-a185-4cff-bbb3-f20cf08e369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 54ca09d8-e407-4053-8a27-e318b74211b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f2eaee09-d1ec-429f-a7a2-90f8bd930e13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:00:33 user nova-compute[72894]: INFO nova.network.neutron [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Port cce01aaf-4443-4dc2-8fcf-601daa33bdbc from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [{"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Releasing lock "refresh_cache-9e9e5bd9-2ca4-49ef-a09a-927cf569be66" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dad93166-0d18-4dfe-925a-4acba1561b78 tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "interface-9e9e5bd9-2ca4-49ef-a09a-927cf569be66-cce01aaf-4443-4dc2-8fcf-601daa33bdbc" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.478s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-258a31e1-d23d-49dc-8dfe-a81a84ef0e3e req-464b8fcd-9461-45b0-b16c-70e57c0e90e6 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-deleted-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:33 user nova-compute[72894]: WARNING nova.compute.manager [req-bee998e2-2dd0-4c74-a77b-bc7f07920a0a req-4909b99c-795a-4730-9498-3fde169ff74f service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-cce01aaf-4443-4dc2-8fcf-601daa33bdbc for instance with vm_state active and task_state None.
Aug 16 20:00:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:00:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.utils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba17f673-2a4b-4fbb-9912-8151d44550f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561492d-3d3f-49c7-b1ce-4dff530da26d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[af722ebe-aa0a-44c7-8593-4b842ecc11c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb039449-a8bc-423e-8f72-12cb9aa3da58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:00:35 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:00:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b57d801-849c-4fa8-bcf1-b78176e9f094]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG os_brick.utils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:35 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating existing volume attachment record: b2ff84ed-56ca-4da7-bf52-955027ecb0c9 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:00:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:00:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Creating image(s)
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Ensure instance console log exists: /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start _get_guest_xml network_info=[{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b2ff84ed-56ca-4da7-bf52-955027ecb0c9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '133d92d6-70ca-4d7e-90d1-4edd276e716f', 'attached_at': '', 'detached_at': '', 'volume_id': '4678fdb8-71ab-4318-bdfc-f7382f737350', 'serial': '4678fdb8-71ab-4318-bdfc-f7382f737350'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:00:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:00:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:00:48 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f68b3-a610-4551-87ca-47469a4c2818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:00:48 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf64f55-579e-4989-9c3f-08231094c081]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350] added
Aug 16 20:00:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf681c-4b1c-4880-9159-22082f582138]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1c1e02-1a72-4a17-a631-23523686b7b6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIwegxKf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIwegxKf" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e984ec1-9ea0-43f8-9c26-7ab15b630936]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIwegxKf'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[004793c3-fadf-4156-95dc-9781c33d1b1f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9251ac5-f1c3-4947-979d-5075d0a9b586]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd535d-cbe6-4cb0-a41e-dbf31d8f58f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260]
Aug 16 20:00:49 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260] successful.
Aug 16 20:00:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5843d-1e16-4c83-b022-3e575f860227]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca7c7c-8a5c-4854-8e5c-da3418e66a1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:00:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8559bb-39bc-499b-8601-44bff55e672f]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:00:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26138643337346363', 'path': '/dev/sdh'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138643337346363', 'path': '/dev/sdh'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1386601857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1386601857',id=10,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-0wa2lq9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:00:30Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=133d92d6-70ca-4d7e-90d1-4edd276e716f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:00:50 user nova-compute[72894]:   <uuid>133d92d6-70ca-4d7e-90d1-4edd276e716f</uuid>
Aug 16 20:00:50 user nova-compute[72894]:   <name>instance-0000000a</name>
Aug 16 20:00:50 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:00:50 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:00:50 user nova-compute[72894]:   <metadata>
Aug 16 20:00:50 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:00:50 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1386601857</nova:name>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:00:48</nova:creationTime>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:00:50 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:00:50 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:owner>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 20:00:50 user nova-compute[72894]:       </nova:owner>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:00:50 user nova-compute[72894]:       <nova:ports>
Aug 16 20:00:50 user nova-compute[72894]:         <nova:port uuid="721c25e7-589b-4efc-9922-305a60a69af1">
Aug 16 20:00:50 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:00:50 user nova-compute[72894]:         </nova:port>
Aug 16 20:00:50 user nova-compute[72894]:       </nova:ports>
Aug 16 20:00:50 user nova-compute[72894]:     </nova:instance>
Aug 16 20:00:50 user nova-compute[72894]:   </metadata>
Aug 16 20:00:50 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:00:50 user nova-compute[72894]:     <system>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="serial">133d92d6-70ca-4d7e-90d1-4edd276e716f</entry>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="uuid">133d92d6-70ca-4d7e-90d1-4edd276e716f</entry>
Aug 16 20:00:50 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:00:50 user nova-compute[72894]:     </system>
Aug 16 20:00:50 user nova-compute[72894]:   </sysinfo>
Aug 16 20:00:50 user nova-compute[72894]:   <os>
Aug 16 20:00:50 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:00:50 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:00:50 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:00:50 user nova-compute[72894]:   </os>
Aug 16 20:00:50 user nova-compute[72894]:   <features>
Aug 16 20:00:50 user nova-compute[72894]:     <acpi/>
Aug 16 20:00:50 user nova-compute[72894]:     <apic/>
Aug 16 20:00:50 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:00:50 user nova-compute[72894]:   </features>
Aug 16 20:00:50 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:00:50 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:00:50 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:00:50 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:00:50 user nova-compute[72894]:   </clock>
Aug 16 20:00:50 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:00:50 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:00:50 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:00:50 user nova-compute[72894]:   </cpu>
Aug 16 20:00:50 user nova-compute[72894]:   <devices>
Aug 16 20:00:50 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:00:50 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:00:50 user nova-compute[72894]:       <source dev="/dev/sdh"/>
Aug 16 20:00:50 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:00:50 user nova-compute[72894]:       <serial>4678fdb8-71ab-4318-bdfc-f7382f737350</serial>
Aug 16 20:00:50 user nova-compute[72894]:     </disk>
Aug 16 20:00:50 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:00:50 user nova-compute[72894]:       <mac address="fa:16:3e:24:08:74"/>
Aug 16 20:00:50 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:50 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:00:50 user nova-compute[72894]:       <target dev="tap721c25e7-58"/>
Aug 16 20:00:50 user nova-compute[72894]:     </interface>
Aug 16 20:00:50 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:00:50 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/console.log" append="off"/>
Aug 16 20:00:50 user nova-compute[72894]:     </serial>
Aug 16 20:00:50 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:00:50 user nova-compute[72894]:     <video>
Aug 16 20:00:50 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:00:50 user nova-compute[72894]:     </video>
Aug 16 20:00:50 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:00:50 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:00:50 user nova-compute[72894]:     </rng>
Aug 16 20:00:50 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:00:50 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:00:50 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:00:50 user nova-compute[72894]:     </memballoon>
Aug 16 20:00:50 user nova-compute[72894]:   </devices>
Aug 16 20:00:50 user nova-compute[72894]: </domain>
Aug 16 20:00:50 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1386601857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1386601857',id=10,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-0wa2lq9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:00:30Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=133d92d6-70ca-4d7e-90d1-4edd276e716f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG os_vif [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap721c25e7-58, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap721c25e7-58, col_values=(('external_ids', {'iface-id': '721c25e7-589b-4efc-9922-305a60a69af1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:08:74', 'vm-uuid': '133d92d6-70ca-4d7e-90d1-4edd276e716f'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:50 user nova-compute[72894]: INFO os_vif [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58')
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:24:08:74, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:00:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:51 user nova-compute[72894]: WARNING nova.compute.manager [req-417dfe17-7a72-4582-a19f-e37df00db5b7 req-b1dac3e9-fcdc-4443-bccf-6269321ee8d4 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state building and task_state spawning.
Aug 16 20:00:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216053.9288669, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:00:53 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Resumed (Lifecycle Event)
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:00:53 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance spawned successfully.
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:00:53 user nova-compute[72894]: WARNING nova.compute.manager [req-02f46506-f7c8-4adc-b76a-c15c46a9729c req-800e42b7-5db4-4420-8f68-291011796c69 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state building and task_state spawning.
Aug 16 20:00:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:00:54 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216053.9291415, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:00:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Started (Lifecycle Event)
Aug 16 20:00:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:00:54 user nova-compute[72894]: INFO nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 16 20:00:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:00:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:00:54 user nova-compute[72894]: INFO nova.compute.manager [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Took 25.39 seconds to build instance.
Aug 16 20:00:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d4c97379-5545-461e-9d21-da3afe1a37af tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.505s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:00:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:00:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:01:03 user nova-compute[72894]: INFO nova.compute.claims [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Claim successful on node user
Aug 16 20:01:03 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:01:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:01:04 user nova-compute[72894]: INFO nova.virt.block_device [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Booting with volume 962748d6-0dd6-4d49-88af-0a5065fdb942 at /dev/vda
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.policy [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d2f3c49803349e8a00bbfaa2f719f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610a8e08203746ce83219f039ef1c99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.utils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d5c9a-b0b5-4ca1-9d5b-dab11f2db12c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa49348-b7b5-4624-aff2-3d446a740563]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962f8d7-7b8b-46b8-8bfa-89aae773e414]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4a4f2f-dff1-4e7f-bf18-4b93ccec3ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:01:04 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:01:04 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[da39d0a1-e6bd-46f3-a4a4-0a62dc105a35]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG os_brick.utils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating existing volume attachment record: 3c9f1b8d-603d-4988-baa4-cd65ded2ab51 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:01:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Successfully created port: 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Successfully updated port: 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing instance network info cache due to event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance network_info: |[{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:01:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated VIF entry in instance network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:01:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03322c6c-4411-4c93-903c-13bf8068e55a req-1b26987b-f429-45f7-9902-acf47507416a service nova] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:07 user nova-compute[72894]: INFO nova.compute.manager [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Terminating instance
Aug 16 20:01:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-unplugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] No waiting events found dispatching network-vif-unplugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-aad3e765-bc40-406c-99c9-acbb04466eac req-342ea17a-deab-4a2c-a5c1-2c349c93f105 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-unplugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Instance destroyed successfully.
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lazy-loading 'resources' on Instance uuid 8221cae3-a185-4cff-bbb3-f20cf08e369b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1082279093',display_name='tempest-VolumesAssistedSnapshotsTest-server-1082279093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1082279093',id=5,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSaW7bHo8ffed3n0hTz0IWiacz4bz1UJYwvP5zM/60aEoiE+tnp67mCnKGFzYgXBwun9xk5TAdbDzfYCk/kxDCK+vEXCKrJ3FokYruHlVeq3rnoUFnr0dCRf0NITvpVDQ==',key_name='tempest-keypair-667819731',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='317ff567df974b26915a694ecef12434',ramdisk_id='',reservation_id='r-9emt5gf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-140938868',owner_user_name='tempest-VolumesAssistedSnapshotsTest-140938868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209ab74834804fa3b563882443745016',uuid=8221cae3-a185-4cff-bbb3-f20cf08e369b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converting VIF {"id": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "address": "fa:16:3e:48:c3:9b", "network": {"id": "7188af34-ce1f-40d1-8456-d0620d0274a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-725257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "317ff567df974b26915a694ecef12434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63efa10d-cb", "ovs_interfaceid": "63efa10d-cb37-4eaf-a1f4-0032c4f34cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG os_vif [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63efa10d-cb, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:08 user nova-compute[72894]: INFO os_vif [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:c3:9b,bridge_name='br-int',has_traffic_filtering=True,id=63efa10d-cb37-4eaf-a1f4-0032c4f34cda,network=Network(7188af34-ce1f-40d1-8456-d0620d0274a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63efa10d-cb')
Aug 16 20:01:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Deleting instance files /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b_del
Aug 16 20:01:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Deletion of /opt/stack/data/nova/instances/8221cae3-a185-4cff-bbb3-f20cf08e369b_del complete
Aug 16 20:01:08 user nova-compute[72894]: INFO nova.compute.manager [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 20:01:08 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:01:08 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:01:09 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:09 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Took 0.96 seconds to deallocate network for instance.
Aug 16 20:01:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:10 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Deleted allocations for instance 8221cae3-a185-4cff-bbb3-f20cf08e369b
Aug 16 20:01:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8150cc82-efe9-439c-9bf6-037a28dcdde4 tempest-VolumesAssistedSnapshotsTest-140938868 tempest-VolumesAssistedSnapshotsTest-140938868-project-member] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] Acquiring lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] Lock "8221cae3-a185-4cff-bbb3-f20cf08e369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] No waiting events found dispatching network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:10 user nova-compute[72894]: WARNING nova.compute.manager [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received unexpected event network-vif-plugged-63efa10d-cb37-4eaf-a1f4-0032c4f34cda for instance with vm_state deleted and task_state None.
Aug 16 20:01:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-428be2b7-e43f-4fe9-9269-2183b4b702e5 req-00aa21aa-7da8-4f31-b05c-6825d93c4897 service nova] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Received event network-vif-deleted-63efa10d-cb37-4eaf-a1f4-0032c4f34cda {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:21 user nova-compute[72894]: INFO nova.compute.manager [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Terminating instance
Aug 16 20:01:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:01:21 user nova-compute[72894]: INFO nova.compute.claims [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Claim successful on node user
Aug 16 20:01:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:22 user nova-compute[72894]: INFO nova.compute.manager [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Terminating instance
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-unplugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-unplugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-8130ddc2-8b9b-4c23-9f4d-7e23b49061c0 req-8ae71c2d-c307-4475-a5d8-525ef5147ddb service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-unplugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:01:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:01:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Creating image(s)
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Instance destroyed successfully.
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lazy-loading 'resources' on Instance uuid 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Instance destroyed successfully.
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'resources' on Instance uuid f2eaee09-d1ec-429f-a7a2-90f8bd930e13 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:22 user nova-compute[72894]: DEBUG nova.policy [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6787ebe74f6445caa43d44813f58ab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d388dc7ba4643d198d2999ec1f87afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-260289859',display_name='tempest-VolumesActionsTest-instance-260289859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-260289859',id=9,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-yrx9myi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:38Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=f2eaee09-d1ec-429f-a7a2-90f8bd930e13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "address": "fa:16:3e:35:e4:0f", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c5c95-1f", "ovs_interfaceid": "da5c5c95-1f0d-4f02-aecc-590f94f6b75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG os_vif [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda5c5c95-1f, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: INFO os_vif [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e4:0f,bridge_name='br-int',has_traffic_filtering=True,id=da5c5c95-1f0d-4f02-aecc-590f94f6b75f,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c5c95-1f')
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Deleting instance files /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13_del
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Deletion of /opt/stack/data/nova/instances/f2eaee09-d1ec-429f-a7a2-90f8bd930e13_del complete
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:58:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2063957319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2063957319',id=6,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOEMZNBAT8PkXPo4PtxCCnSHQPFXy3/EwYq6wpJam8H7hiAlrJWht2V/exYm9UXI7xEh6NhojQZ3yAKipHVH+QNU1Jc5ZV+vscHbOlTFRN4I9EErdW1R6j3/p/FwQR9+w==',key_name='tempest-keypair-1537915385',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebaf7d30d23f445d8b52521dcfc637e2',ramdisk_id='',reservation_id='r-t0v7d81f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1281191126',owner_user_name='tempest-TaggedAttachmentsTest-1281191126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21bae0264e7d4b53b420644daf702684',uuid=9e9e5bd9-2ca4-49ef-a09a-927cf569be66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converting VIF {"id": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "address": "fa:16:3e:eb:a7:2d", "network": {"id": "c8bd8d32-388f-419f-be5b-fe2fc814eb1c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1291819145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebaf7d30d23f445d8b52521dcfc637e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3642a60-02", "ovs_interfaceid": "d3642a60-024d-4af0-8353-7a6a9d6bb136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG os_vif [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3642a60-02, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:23 user nova-compute[72894]: INFO os_vif [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:2d,bridge_name='br-int',has_traffic_filtering=True,id=d3642a60-024d-4af0-8353-7a6a9d6bb136,network=Network(c8bd8d32-388f-419f-be5b-fe2fc814eb1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3642a60-02')
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Deleting instance files /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66_del
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Deletion of /opt/stack/data/nova/instances/9e9e5bd9-2ca4-49ef-a09a-927cf569be66_del complete
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.compute.manager [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.compute.manager [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk 1073741824" returned: 0 in 0.052s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216068.7506533, 8221cae3-a185-4cff-bbb3-f20cf08e369b => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] VM Stopped (Lifecycle Event)
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Cannot resize image /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'migration_context' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-139a59e8-adbd-4030-8f15-66883cdad9e7 None None] [instance: 8221cae3-a185-4cff-bbb3-f20cf08e369b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Ensure instance console log exists: /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:23 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Took 0.65 seconds to deallocate network for instance.
Aug 16 20:01:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-cbafaa87-9983-4296-8289-0f221b1ae929 req-8f2f7c8d-bf9b-4721-8769-68416fa582f4 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-vif-deleted-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Successfully created port: 95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:24 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Deleted allocations for instance f2eaee09-d1ec-429f-a7a2-90f8bd930e13
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Acquiring lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] No waiting events found dispatching network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:24 user nova-compute[72894]: WARNING nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received unexpected event network-vif-plugged-d3642a60-024d-4af0-8353-7a6a9d6bb136 for instance with vm_state active and task_state deleting.
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-vif-unplugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] No waiting events found dispatching network-vif-unplugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:24 user nova-compute[72894]: WARNING nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received unexpected event network-vif-unplugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f for instance with vm_state deleted and task_state None.
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Acquiring lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] No waiting events found dispatching network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:24 user nova-compute[72894]: WARNING nova.compute.manager [req-ca0f67a4-c3e6-4a1e-b6a0-52e85878bd23 req-34667815-a83a-4e52-a97a-2767a9d55fd1 service nova] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Received unexpected event network-vif-plugged-da5c5c95-1f0d-4f02-aecc-590f94f6b75f for instance with vm_state deleted and task_state None.
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-edb93c94-0e01-433a-95bb-d31e2704c853 tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "f2eaee09-d1ec-429f-a7a2-90f8bd930e13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:24 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Took 1.40 seconds to deallocate network for instance.
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:25 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Deleted allocations for instance 9e9e5bd9-2ca4-49ef-a09a-927cf569be66
Aug 16 20:01:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ece39722-de9d-4ca9-bd4b-f123fd29a9ab tempest-TaggedAttachmentsTest-1281191126 tempest-TaggedAttachmentsTest-1281191126-project-member] Lock "9e9e5bd9-2ca4-49ef-a09a-927cf569be66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.525s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Successfully updated port: 95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-changed-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Refreshing instance network info cache due to event network-changed-95d8940b-470c-4483-844f-a4f46d7059c5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] Acquiring lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating instance_info_cache with network_info: [{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance network_info: |[{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] Acquired lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Refreshing network info cache for port 95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start _get_guest_xml network_info=[{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:01:26 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:26 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-tempest.common.compute-instance-1567234370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_devices' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:01:26 user nova-compute[72894]:   <uuid>ff3a42d6-469e-4194-be6d-eacc72cc87fd</uuid>
Aug 16 20:01:26 user nova-compute[72894]:   <name>instance-0000000c</name>
Aug 16 20:01:26 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:01:26 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:01:26 user nova-compute[72894]:   <metadata>
Aug 16 20:01:26 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:01:26 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:name>tempest-tempest.common.compute-instance-1567234370</nova:name>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:01:26</nova:creationTime>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:01:26 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:01:26 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:owner>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:user uuid="6787ebe74f6445caa43d44813f58ab21">tempest-ServerActionsTestOtherA-2019589976-project-member</nova:user>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:project uuid="0d388dc7ba4643d198d2999ec1f87afe">tempest-ServerActionsTestOtherA-2019589976</nova:project>
Aug 16 20:01:26 user nova-compute[72894]:       </nova:owner>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:01:26 user nova-compute[72894]:       <nova:ports>
Aug 16 20:01:26 user nova-compute[72894]:         <nova:port uuid="95d8940b-470c-4483-844f-a4f46d7059c5">
Aug 16 20:01:26 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:01:26 user nova-compute[72894]:         </nova:port>
Aug 16 20:01:26 user nova-compute[72894]:       </nova:ports>
Aug 16 20:01:26 user nova-compute[72894]:     </nova:instance>
Aug 16 20:01:26 user nova-compute[72894]:   </metadata>
Aug 16 20:01:26 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:01:26 user nova-compute[72894]:     <system>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="serial">ff3a42d6-469e-4194-be6d-eacc72cc87fd</entry>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="uuid">ff3a42d6-469e-4194-be6d-eacc72cc87fd</entry>
Aug 16 20:01:26 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:01:26 user nova-compute[72894]:     </system>
Aug 16 20:01:26 user nova-compute[72894]:   </sysinfo>
Aug 16 20:01:26 user nova-compute[72894]:   <os>
Aug 16 20:01:26 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:01:26 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:01:26 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:01:26 user nova-compute[72894]:   </os>
Aug 16 20:01:26 user nova-compute[72894]:   <features>
Aug 16 20:01:26 user nova-compute[72894]:     <acpi/>
Aug 16 20:01:26 user nova-compute[72894]:     <apic/>
Aug 16 20:01:26 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:01:26 user nova-compute[72894]:   </features>
Aug 16 20:01:26 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:01:26 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:01:26 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:01:26 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:01:26 user nova-compute[72894]:   </clock>
Aug 16 20:01:26 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:01:26 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:01:26 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:01:26 user nova-compute[72894]:   </cpu>
Aug 16 20:01:26 user nova-compute[72894]:   <devices>
Aug 16 20:01:26 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:01:26 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:01:26 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk"/>
Aug 16 20:01:26 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:01:26 user nova-compute[72894]:     </disk>
Aug 16 20:01:26 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:01:26 user nova-compute[72894]:       <mac address="fa:16:3e:cd:76:ff"/>
Aug 16 20:01:26 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:26 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:01:26 user nova-compute[72894]:       <target dev="tap95d8940b-47"/>
Aug 16 20:01:26 user nova-compute[72894]:     </interface>
Aug 16 20:01:26 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:01:26 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/console.log" append="off"/>
Aug 16 20:01:26 user nova-compute[72894]:     </serial>
Aug 16 20:01:26 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:01:26 user nova-compute[72894]:     <video>
Aug 16 20:01:26 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:26 user nova-compute[72894]:     </video>
Aug 16 20:01:26 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:01:26 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:01:26 user nova-compute[72894]:     </rng>
Aug 16 20:01:26 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:01:26 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:01:26 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:01:26 user nova-compute[72894]:     </memballoon>
Aug 16 20:01:26 user nova-compute[72894]:   </devices>
Aug 16 20:01:26 user nova-compute[72894]: </domain>
Aug 16 20:01:26 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-tempest.common.compute-instance-1567234370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG os_vif [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95d8940b-47, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95d8940b-47, col_values=(('external_ids', {'iface-id': '95d8940b-470c-4483-844f-a4f46d7059c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:76:ff', 'vm-uuid': 'ff3a42d6-469e-4194-be6d-eacc72cc87fd'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:26 user nova-compute[72894]: INFO os_vif [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47')
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-061ad517-13c2-4630-b0bb-65c033e1cb84 req-f7a26bd4-64ae-4e62-8fd8-9ec691e922ca service nova] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Received event network-vif-deleted-d3642a60-024d-4af0-8353-7a6a9d6bb136 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:cd:76:ff, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updated VIF entry in instance network info cache for port 95d8940b-470c-4483-844f-a4f46d7059c5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating instance_info_cache with network_info: [{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dc6653dd-89e1-4239-83ed-647d776c8307 req-4ab7a42c-b9f2-4e33-8e2c-e85d1de77bd9 service nova] Releasing lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:27 user nova-compute[72894]: WARNING nova.compute.manager [req-3bb534af-950a-48a4-aa69-96c90ec1cdfa req-3b23162b-2811-4791-b5ec-295cfc4d8c26 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state building and task_state spawning.
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216089.8702986, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Resumed (Lifecycle Event)
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:01:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance spawned successfully.
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216089.8722458, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Started (Lifecycle Event)
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:01:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:01:30 user nova-compute[72894]: INFO nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Took 7.16 seconds to spawn the instance on the hypervisor.
Aug 16 20:01:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:30 user nova-compute[72894]: WARNING nova.compute.manager [req-c1fe319a-8d13-4743-a099-2959bdd29d24 req-8f8f6106-12c0-4cbf-ade0-3a18794fcec3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state building and task_state spawning.
Aug 16 20:01:30 user nova-compute[72894]: INFO nova.compute.manager [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Took 8.23 seconds to build instance.
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca8ef85d-e142-44ed-88e0-85b15dcb2bcf tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.362s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=24.776470184326172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 54ca09d8-e407-4053-8a27-e318b74211b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'flavor' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:34 user nova-compute[72894]: INFO nova.compute.manager [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Attaching volume 91f3c5f5-09ab-464c-9d18-53e44b97f616 to /dev/vdb
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80556c-030e-4dae-a30a-67d8263cbfe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecedc25-abef-4892-8739-4bf5c86389b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c957c-ee0f-4bec-b888-178951f6754b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6e1da-df36-4b1a-b190-507404c747ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:01:34 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:01:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac7d5e-8979-4c74-a277-346fbe0ce585]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:34 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating existing volume attachment record: 812d204e-fae2-4f1a-aceb-4185573579db {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:01:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:01:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Creating image(s)
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Ensure instance console log exists: /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start _get_guest_xml network_info=[{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '3c9f1b8d-603d-4988-baa4-cd65ded2ab51', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58ff42d5-d55e-4d30-b71a-2c64b22b35a3', 'attached_at': '', 'detached_at': '', 'volume_id': '962748d6-0dd6-4d49-88af-0a5065fdb942', 'serial': '962748d6-0dd6-4d49-88af-0a5065fdb942'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:01:36 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:36 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:36 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:36 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:36 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:01:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[54739d6e-e472-4483-bb9d-0de555984844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:01:37 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd86b4-23e5-4993-8153-ae002aeef4d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942] added
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d604cff-c557-4bae-b9f0-bc1f961d5e48]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d40bd-d3b0-47fd-b817-a1c30991cff4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWJolnAS {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWJolnAS" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4a15ea-1093-4cfd-8b06-de3d305e47bc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWJolnAS'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5054dae8-f298-4fee-b76a-cf3e8ed5490a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5161d55-702f-4bc9-9499-88ed75e3c874]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[356bd350-7a8b-43a6-850f-633c258aab98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]
Aug 16 20:01:37 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bc1e7-dee4-4cd7-b514-25df486ce512]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc3979-6e65-4854-8c28-9a79068c6ffd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe273c97-40b9-4ba7-b7b5-7350570c036d]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216082.9546251, 9e9e5bd9-2ca4-49ef-a09a-927cf569be66 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:37 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] VM Stopped (Lifecycle Event)
Aug 16 20:01:37 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216082.9717047, f2eaee09-d1ec-429f-a7a2-90f8bd930e13 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:37 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] VM Stopped (Lifecycle Event)
Aug 16 20:01:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6f7d0414-556b-4dfd-bc18-e6ad74de5dfb None None] [instance: 9e9e5bd9-2ca4-49ef-a09a-927cf569be66] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3fa9205-fc9e-4460-9865-2bca5cc9224b None None] [instance: f2eaee09-d1ec-429f-a7a2-90f8bd930e13] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23265633832376163', 'path': '/dev/sdi'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265633832376163', 'path': '/dev/sdi'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCIC1lih8ZhTOQnbgqKwnejhzZhSn9ZbbdBeKAtGmF4RIWc3My0AeBFwVh0XOPwawoYZSTtSlGv+CVCKF0Bys5iZoT+K3+qASd46AIDrLO7i4YD55nJ9KhayC9B08IG+A==',key_name='tempest-TestShelveInstance-37858656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:04Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'pci_devices' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:01:38 user nova-compute[72894]:   <uuid>58ff42d5-d55e-4d30-b71a-2c64b22b35a3</uuid>
Aug 16 20:01:38 user nova-compute[72894]:   <name>instance-0000000b</name>
Aug 16 20:01:38 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:01:38 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:01:38 user nova-compute[72894]:   <metadata>
Aug 16 20:01:38 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:01:38 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:01:38 user nova-compute[72894]:       <nova:name>tempest-TestShelveInstance-server-458187134</nova:name>
Aug 16 20:01:38 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:01:36</nova:creationTime>
Aug 16 20:01:38 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:01:38 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:01:38 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:01:38 user nova-compute[72894]:       <nova:owner>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:user uuid="3d2f3c49803349e8a00bbfaa2f719f85">tempest-TestShelveInstance-1481575186-project-member</nova:user>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:project uuid="610a8e08203746ce83219f039ef1c99e">tempest-TestShelveInstance-1481575186</nova:project>
Aug 16 20:01:38 user nova-compute[72894]:       </nova:owner>
Aug 16 20:01:38 user nova-compute[72894]:       <nova:ports>
Aug 16 20:01:38 user nova-compute[72894]:         <nova:port uuid="5c4317ba-fb95-423b-bf5c-94cfd816ffd0">
Aug 16 20:01:38 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:01:38 user nova-compute[72894]:         </nova:port>
Aug 16 20:01:38 user nova-compute[72894]:       </nova:ports>
Aug 16 20:01:38 user nova-compute[72894]:     </nova:instance>
Aug 16 20:01:38 user nova-compute[72894]:   </metadata>
Aug 16 20:01:38 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:01:38 user nova-compute[72894]:     <system>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="serial">58ff42d5-d55e-4d30-b71a-2c64b22b35a3</entry>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="uuid">58ff42d5-d55e-4d30-b71a-2c64b22b35a3</entry>
Aug 16 20:01:38 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:01:38 user nova-compute[72894]:     </system>
Aug 16 20:01:38 user nova-compute[72894]:   </sysinfo>
Aug 16 20:01:38 user nova-compute[72894]:   <os>
Aug 16 20:01:38 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:01:38 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:01:38 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:01:38 user nova-compute[72894]:   </os>
Aug 16 20:01:38 user nova-compute[72894]:   <features>
Aug 16 20:01:38 user nova-compute[72894]:     <acpi/>
Aug 16 20:01:38 user nova-compute[72894]:     <apic/>
Aug 16 20:01:38 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:01:38 user nova-compute[72894]:   </features>
Aug 16 20:01:38 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:01:38 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:01:38 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:01:38 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:01:38 user nova-compute[72894]:   </clock>
Aug 16 20:01:38 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:01:38 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:01:38 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:01:38 user nova-compute[72894]:   </cpu>
Aug 16 20:01:38 user nova-compute[72894]:   <devices>
Aug 16 20:01:38 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:01:38 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:01:38 user nova-compute[72894]:       <source dev="/dev/sdi"/>
Aug 16 20:01:38 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:01:38 user nova-compute[72894]:       <serial>962748d6-0dd6-4d49-88af-0a5065fdb942</serial>
Aug 16 20:01:38 user nova-compute[72894]:     </disk>
Aug 16 20:01:38 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:01:38 user nova-compute[72894]:       <mac address="fa:16:3e:25:60:bd"/>
Aug 16 20:01:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:38 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:01:38 user nova-compute[72894]:       <target dev="tap5c4317ba-fb"/>
Aug 16 20:01:38 user nova-compute[72894]:     </interface>
Aug 16 20:01:38 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:01:38 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3/console.log" append="off"/>
Aug 16 20:01:38 user nova-compute[72894]:     </serial>
Aug 16 20:01:38 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:01:38 user nova-compute[72894]:     <video>
Aug 16 20:01:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:38 user nova-compute[72894]:     </video>
Aug 16 20:01:38 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:01:38 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:01:38 user nova-compute[72894]:     </rng>
Aug 16 20:01:38 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:01:38 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:01:38 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:01:38 user nova-compute[72894]:     </memballoon>
Aug 16 20:01:38 user nova-compute[72894]:   </devices>
Aug 16 20:01:38 user nova-compute[72894]: </domain>
Aug 16 20:01:38 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCIC1lih8ZhTOQnbgqKwnejhzZhSn9ZbbdBeKAtGmF4RIWc3My0AeBFwVh0XOPwawoYZSTtSlGv+CVCKF0Bys5iZoT+K3+qASd46AIDrLO7i4YD55nJ9KhayC9B08IG+A==',key_name='tempest-TestShelveInstance-37858656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:04Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG os_vif [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c4317ba-fb, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c4317ba-fb, col_values=(('external_ids', {'iface-id': '5c4317ba-fb95-423b-bf5c-94cfd816ffd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:60:bd', 'vm-uuid': '58ff42d5-d55e-4d30-b71a-2c64b22b35a3'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:38 user nova-compute[72894]: INFO os_vif [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb')
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:01:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] No VIF found with MAC fa:16:3e:25:60:bd, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:01:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:40 user nova-compute[72894]: WARNING nova.compute.manager [req-fcf85b6b-8447-4691-b1a0-cb6d7f51c0b7 req-4b854bc8-b63e-4438-9f56-c1ea6273ada2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state building and task_state spawning.
Aug 16 20:01:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216102.1389992, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Resumed (Lifecycle Event)
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance spawned successfully.
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216102.149079, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Started (Lifecycle Event)
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:42 user nova-compute[72894]: WARNING nova.compute.manager [req-dcbdfd0a-6f86-4cd1-a1a9-7383d0b976f2 req-9044452e-45e2-4fb8-a7bc-68e91abba0ad service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state building and task_state spawning.
Aug 16 20:01:42 user nova-compute[72894]: INFO nova.compute.manager [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Took 38.90 seconds to build instance.
Aug 16 20:01:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-570eb442-5c44-4fa2-968f-5a5e796f2ec0 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.096s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-changed-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing instance network info cache due to event network-changed-3b0566f7-949c-414d-b1ff-91990d9ea863. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Acquiring lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Acquired lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Refreshing network info cache for port 3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:01:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updated VIF entry in instance network info cache for port 3b0566f7-949c-414d-b1ff-91990d9ea863. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Releasing lock "refresh_cache-54ca09d8-e407-4053-8a27-e318b74211b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-changed-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing instance network info cache due to event network-changed-0402f95a-9d72-4183-ad59-ba52ddfb8ab3. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Acquiring lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Acquired lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Refreshing network info cache for port 0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:48 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a94b3a5-07a5-4339-bf06-aa470156714a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:01:48 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90f87b-2a71-4f7d-984c-3805becf5c8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added
Aug 16 20:01:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b08d96-0bed-47e6-b47e-6868e33f4a4a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9de21-bf05-49e0-874e-d3486d0da2d4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31184ee-96b4-4ee1-abb0-8aa892a1d73e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTxWSRoZ'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:48 user nova-compute[72894]: INFO nova.compute.manager [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Terminating instance
Aug 16 20:01:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b77a7-ee3a-49a1-986f-3472b65cd034]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99733a-0f96-4f32-95ac-e6751d9fd8bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e7cd04-c771-4672-a212-d7ae41f64ee7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:01:48 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updated VIF entry in instance network info cache for port 0402f95a-9d72-4183-ad59-ba52ddfb8ab3. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8393293-9706-42df-89b2-d1764cd87052]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efe681f1-5acb-4e81-8255-01f733d03386 req-30d0d103-093e-437e-9b89-c980867caf09 service nova] Releasing lock "refresh_cache-1f02f480-8b2c-42c6-b7e7-bc8d397daa80" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea1692-2347-4621-926b-472db47f9214]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[028fe6e3-0cc9-4565-baa4-032f4e121913]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:49 user nova-compute[72894]: INFO nova.compute.manager [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Terminating instance
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-101016d9-b4c8-40e6-9d90-18829d9d5483 req-2e0111e2-e15d-49df-a70d-8500d9f251ee service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-84f966cb-c1d2-4dba-80f4-1e1a1066c1fb req-30579fb6-74ef-4768-a4a8-bd15b9d07e1f service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdj'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdj'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'flavor' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:01:50 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:01:50 user nova-compute[72894]:   <source dev="/dev/sdj"/>
Aug 16 20:01:50 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:01:50 user nova-compute[72894]:   <serial>91f3c5f5-09ab-464c-9d18-53e44b97f616</serial>
Aug 16 20:01:50 user nova-compute[72894]: </disk>
Aug 16 20:01:50 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Instance destroyed successfully.
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lazy-loading 'resources' on Instance uuid 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0402f95a-9d, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No VIF found with MAC fa:16:3e:30:37:0b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:01:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cfeaf4e-68b6-41fc-b65b-13545cd4d383 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.385s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:74:09,bridge_name='br-int',has_traffic_filtering=True,id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3,network=Network(3729165c-17ef-48d2-b0b7-7bf1b4423d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0402f95a-9d')
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaadd6e4-92, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-2411431b-e61d-4a10-803d-a64dee4b2c66 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-2411431b-e61d-4a10-803d-a64dee4b2c66 for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-25145c72-85a5-4565-9880-593db50b9a9d for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-55a40596-522e-442a-99b8-82e30cb9bb09 req-f1581c26-86d5-4b94-9fb9-9e361ebf4851 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-25145c72-85a5-4565-9880-593db50b9a9d for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-baadd6e4-92da-47e6-9c23-d8020a9db4a0 for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-3b0566f7-949c-414d-b1ff-91990d9ea863 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-3b0566f7-949c-414d-b1ff-91990d9ea863 for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: WARNING nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c for instance with vm_state active and task_state deleting.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-63ccd840-264f-4c9b-a710-ce65456f43de req-dc87d4fa-78a9-44b1-8aaa-bb97f57fc1de service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-bef2f44a-5979-4676-b04b-985c6b282de8 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ac:db,bridge_name='br-int',has_traffic_filtering=True,id=baadd6e4-92da-47e6-9c23-d8020a9db4a0,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaadd6e4-92')
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2411431b-e6, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Instance destroyed successfully.
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lazy-loading 'resources' on Instance uuid 54ca09d8-e407-4053-8a27-e318b74211b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b0566f7-94, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:51 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2411431b-e61d-4a10-803d-a64dee4b2c66,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2411431b-e6')
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65c2a88-d2, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:cb:93,bridge_name='br-int',has_traffic_filtering=True,id=3b0566f7-949c-414d-b1ff-91990d9ea863,network=Network(09000133-548b-4bdb-b126-0e78eedfbb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0566f7-94')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef2f44a-59, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:03:54,bridge_name='br-int',has_traffic_filtering=True,id=a65c2a88-d2e7-4bfd-b12e-752cf16bddbc,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65c2a88-d2')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d15a98-37, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=bef2f44a-5979-4676-b04b-985c6b282de8,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbef2f44a-59')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9ed96d7-56, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:65:ad,bridge_name='br-int',has_traffic_filtering=True,id=41d15a98-37ee-447c-a70e-513bd31d05e8,network=Network(d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d15a98-37')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "address": "fa:16:3e:ac:9d:89", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019acb8b-ce", "ovs_interfaceid": "019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap019acb8b-ce, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cf:2a,bridge_name='br-int',has_traffic_filtering=True,id=e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ed96d7-56')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25145c72-85, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap019acb8b-ce')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1902308200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1902308200',id=8,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW3rzWXg2ou36ysp1+cTfqP1EsiBnzr9r6R57JGDQdiKthf9nKtIE0OmWXuINLH91kQa/h62VFbHTOv4lvS3JFANbUvp96D13UUG4HP8kc736wDbTINcx0ivgDQKgf1gA==',key_name='tempest-keypair-1516567897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e1f9bc3b28c44328fd761ac44ca82bb',ramdisk_id='',reservation_id='r-q0adc64z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-378966607',owner_user_name='tempest-TaggedBootDevicesTest_v242-378966607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1486c29d5df4d8087e0714694c881db',uuid=1f02f480-8b2c-42c6-b7e7-bc8d397daa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converting VIF {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bc24ff7-23, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4f:2c,bridge_name='br-int',has_traffic_filtering=True,id=25145c72-85a5-4565-9880-593db50b9a9d,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25145c72-85')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91b4d66-eb, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5c:ce,bridge_name='br-int',has_traffic_filtering=True,id=0bc24ff7-23fe-4627-b4e9-716376bb1288,network=Network(e14da2fd-e727-4148-910c-bdbe6a1b2de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc24ff7-23')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdkIGKOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:52 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8d34fe-033f-49eb-a640-c9e3d5026a82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:5d,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d66-eb76-4a91-a1f5-0968b3d40615,network=Network(220a6dff-8688-4f32-a063-df8e1a863eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d66-eb')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "address": "fa:16:3e:6f:df:7d", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74bdb23-3d", "ovs_interfaceid": "d74bdb23-3d85-4fc3-bcba-cedb58966818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd74bdb23-3d, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:df:7d,bridge_name='br-int',has_traffic_filtering=True,id=d74bdb23-3d85-4fc3-bcba-cedb58966818,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74bdb23-3d')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T19:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408212777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-408212777',id=7,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcrRWgCCcJfTUeSz87r07VnxtXWMs6+RvuP8r2TvZ2cfRoBfKMXgb4H3AKysZ/8HWPIbyQOrG9gPHmUAjPVfONu6nNFl5tiTTqpCrSN7cG7w4NgXmkTH/kLLrAwboUg6w==',key_name='tempest-keypair-83383483',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e523c246d424c31ba852e5234f416b5',ramdisk_id='',reservation_id='r-4wcn7pjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-166088539',owner_user_name='tempest-TaggedBootDevicesTest-166088539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10f14678cec34119a408b36cb99f7827',uuid=54ca09d8-e407-4053-8a27-e318b74211b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converting VIF {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap247c5bea-e2, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4d5904-76fd-4f0b-bd7d-a431ef4bdf90]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c6965f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:52 user nova-compute[72894]: INFO os_vif [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:15:7b,bridge_name='br-int',has_traffic_filtering=True,id=247c5bea-e271-4bab-8241-b1bf4a121f5b,network=Network(07f4cfa8-70eb-40b4-bde3-a90122386370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247c5bea-e2')
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvazRHts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:52 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b716eaf-c166-4671-8249-3b0f4e93d972]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9404ac5-4e7e-42a5-97e5-f44e49e94cc0]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731b78f-f3ed-4f08-9e2c-6175405d9d81]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de3af2e-41d4-45e4-8d4e-8a2373b61e32]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a05315-6db9-4a90-b395-7d251a8a29f7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917d9eb-9df2-4efc-8bf1-006d1ca94403]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260]
Aug 16 20:01:53 user nova-compute[72894]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdc4762-8af4-405d-905a-ff5730a8db38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4828dbd1-655b-4611-969f-573dbcc6975d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== disconnect_volume: return (428ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.324s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spnGZqBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce3f574-bb30-45f4-a56f-ee77f11c069b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e94c53-bc05-462c-a29b-1fde3acfad19]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c694700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c4c781-ecf7-4e3a-9de7-d292b5e508ac]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00689d-a47b-4365-909a-80beab141d28]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ef48ef-7a70-4f6d-a57b-6bdfb41272e8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df09ce7-6a92-4f34-be1b-452b022a9c5e]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac17b80-f138-4ba9-b196-ce6a6e07d7af]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1bdd3-e8ce-40db-aed0-fc23441bbd4a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260]
Aug 16 20:01:53 user nova-compute[72894]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e06385e-3b16-447c-a1c9-1cf37346d4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64b4b5-c100-4d35-b54f-d8134443fc45]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== disconnect_volume: return (678ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Stashing vm_state: active {{(pid=72894) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.354s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOdyshvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-0bc24ff7-23fe-4627-b4e9-716376bb1288 for instance with vm_state active and task_state deleting.
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-f91b4d66-eb76-4a91-a1f5-0968b3d40615 for instance with vm_state active and task_state deleting.
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-0045b947-c70e-4db1-b24d-181d4b6f149a req-db016155-5daf-47c9-92a2-df5fdd9758f7 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409d809-ab1b-4730-bace-67a9f4ff1eb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING nova.compute.manager [req-67c6619b-eae5-49a5-98db-3ba6af851ac1 req-88c17032-6fb8-448d-bed0-5bbdfbb524da service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-bef2f44a-5979-4676-b04b-985c6b282de8 for instance with vm_state active and task_state deleting.
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:01:53 user nova-compute[72894]: INFO nova.compute.claims [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Claim successful on node user
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2939f0-3eb8-4532-af22-f2cc6a5bd55f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4b10ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d4d059-d577-4cc2-98c9-25722ed17a0d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec9a103-28b7-46d9-a8c1-a4f76f33910e]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dfde65-d8d0-44e1-990b-7dfb1644c8e6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc508da-cb30-41de-8577-42d2902b4003]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e68955-4cd0-4128-9def-f177ad2dce68]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0626afd6-9d2e-4dc8-a833-bf3ea50a445f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260]
Aug 16 20:01:53 user nova-compute[72894]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:53 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeb6b238-7f26-43d1-aff3-3c9ac74fc6b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e3a3b-4a06-4e5f-86dd-e7ae1861a18a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== disconnect_volume: return (715ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.348s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrCqdGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:53 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e820090-8b2d-4a14-942b-1d020e6353d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e88720b-65f1-4694-905e-fb499a223c63]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79907470a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59'): ({'sdf'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Removing single pathed devices sdf {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e96a00-6c07-41dd-8677-f869b1dc33e5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5587a87d-aa1d-4d7c-87e8-510c357a1ed1]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Flushing IO for device /dev/sdf {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ea5dfe-4244-4062-9817-f3fe23be8e1a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06067038-b6ce-40ca-852a-ed6d9d7c45d2]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1d549-568d-47bc-afaf-dda3c9b8df35]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.440s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'pci_requests' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.compute.claims [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Claim successful on node user
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'resources' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e82ce15-b78c-4d74-9277-da82279b0af0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260]
Aug 16 20:01:54 user nova-compute[72894]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'pci_devices' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ef553d-1f6f-420d-92e1-60f69eb98b59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19107c9-73ce-4960-9dc3-b4bfd8cfe9b7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== disconnect_volume: return (725ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.361s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNJQeanI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:54 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf319bc-2e57-4295-ae13-394eee559fc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating resource usage from migration ff1d0b0a-f652-492b-aca0-618c134935e3
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a88987d-6242-4dce-b042-c0d7b80b737e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79906011b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.policy [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ff8197009d34be7b1aa1ed95f5cf172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30c130e51534270bd374f0315030ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7e5a8-e4c8-4c68-bce8-a1938f95f35d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfa0c8-2c76-462a-9892-3d38256b0767]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Creating image(s)
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "/opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "/opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "/opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e39f7c-c755-4600-8537-6f34f93742f0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7d01fa-03a7-4d69-900c-312a4f78d283]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e0ec8-613c-45cb-af36-b7442e019dfa]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff42c46-10c1-4e0b-9913-e5593e8ef483]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260]
Aug 16 20:01:54 user nova-compute[72894]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41110941-7a45-4e9f-99ac-7a66437fb646 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047915c-a153-422c-8278-e2eed19d712c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] <== disconnect_volume: return (795ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Deleting instance files /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80_del
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Deletion of /opt/stack/data/nova/instances/1f02f480-8b2c-42c6-b7e7-bc8d397daa80_del complete
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.442s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[26313a31-6cf0-426b-8855-4d29318918aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f8ce4-d428-4ac0-952c-f99db432b51c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 (non-flash)
Aug 16 20:01:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7998174310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445'): ({'sdg'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Removing single pathed devices sdg {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.651s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.compute.manager [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Migrating
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.compute.rpcapi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0403738-960f-404f-9ca2-b29db81115a9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: INFO nova.compute.manager [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Took 6.17 seconds to destroy the instance on the hypervisor.
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02de8d2-bfe0-4272-9e99-ae2d11c2000c]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Flushing IO for device /dev/sdg {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411b56e-9bb2-49fd-b42a-d56fcd2f8eb9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.238s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603bd32-bb8f-43c6-9dd8-2847c0c80ae5]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] SCSI volumes sdg have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk 1073741824" returned: 0 in 0.070s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a6d79-cd4a-4de1-b82c-a67976b62b36]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22ee28-139a-4e22-9ebd-c0cabb385a7a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260]
Aug 16 20:01:55 user nova-compute[72894]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:55 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163871a6-414b-410e-9054-67b29509a445 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaa89dc-02a5-48a5-aa85-c439d6a71943]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] <== disconnect_volume: return (851ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Deleting instance files /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5_del
Aug 16 20:01:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Deletion of /opt/stack/data/nova/instances/54ca09d8-e407-4053-8a27-e318b74211b5_del complete
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:55 user nova-compute[72894]: INFO nova.compute.manager [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Took 6.19 seconds to destroy the instance on the hypervisor.
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Cannot resize image /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lazy-loading 'migration_context' on Instance uuid 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Ensure instance console log exists: /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Successfully created port: df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:55 user nova-compute[72894]: WARNING nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-d74bdb23-3d85-4fc3-bcba-cedb58966818 for instance with vm_state active and task_state deleting.
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-unplugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-unplugged-247c5bea-e271-4bab-8241-b1bf4a121f5b for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Acquiring lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] Lock "54ca09d8-e407-4053-8a27-e318b74211b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] No waiting events found dispatching network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:55 user nova-compute[72894]: WARNING nova.compute.manager [req-deb1e37f-2cd4-4585-9587-6e5ee94fe59f req-df0bf567-ced3-4ccd-8efa-3dd16cfcf2fb service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received unexpected event network-vif-plugged-247c5bea-e271-4bab-8241-b1bf4a121f5b for instance with vm_state active and task_state deleting.
Aug 16 20:01:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Starting migrate_disk_and_power_off {{(pid=72894) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Successfully updated port: df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquired lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-changed-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Refreshing instance network info cache due to event network-changed-df6bdd29-6be0-4762-b806-03363d4d20ea. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] Acquiring lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:01:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance destroyed successfully.
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea3d08c-31, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:56 user nova-compute[72894]: INFO os_vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a932a-ccf1-4d5f-9df6-6ba00ecb2579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec70af57-f70f-41fd-b00c-ecd3cb05ba88]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:01:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4b13880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'): ({'sdj'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Removing single pathed devices sdj {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[636ff655-ccba-423d-a67b-0a26e0c0905c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ba6d1d-af8a-4c8c-85fb-565d6c90a500]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flushing IO for device /dev/sdj {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8101a5-76cb-4829-adb3-3602d20bd782]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f588726f-2b60-4066-baf9-b5a23bb105ad]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] SCSI volumes sdj have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5515a8-9c10-4531-815c-867fc580c1eb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Updating instance_info_cache with network_info: [{"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Releasing lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Instance network_info: |[{"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] Acquired lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.neutron [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Refreshing network info cache for port df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Start _get_guest_xml network_info=[{"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[524bf892-25d6-4798-b60f-1bd1ad47cca1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:01:56 user nova-compute[72894]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:01:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:56 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:56 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1390843546',display_name='tempest-VolumesActionsTest-instance-1390843546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1390843546',id=13,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30c130e51534270bd374f0315030ffb',ramdisk_id='',reservation_id='r-xvxzsmux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1741933721',owner_user_name='tempest-VolumesActionsTest-1741933721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:54Z,user_data=None,user_id='4ff8197009d34be7b1aa1ed95f5cf172',uuid=35f08fa1-d2f2-4f51-b588-fbb30f1d5d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converting VIF {"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lazy-loading 'pci_devices' on Instance uuid 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30ab4f-1b55-48a6-96b4-4ef99c7de533]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== disconnect_volume: return (384ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:01:57 user nova-compute[72894]:   <uuid>35f08fa1-d2f2-4f51-b588-fbb30f1d5d54</uuid>
Aug 16 20:01:57 user nova-compute[72894]:   <name>instance-0000000d</name>
Aug 16 20:01:57 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:01:57 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:01:57 user nova-compute[72894]:   <metadata>
Aug 16 20:01:57 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:01:57 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:name>tempest-VolumesActionsTest-instance-1390843546</nova:name>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:01:56</nova:creationTime>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:01:57 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:01:57 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:owner>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:user uuid="4ff8197009d34be7b1aa1ed95f5cf172">tempest-VolumesActionsTest-1741933721-project-member</nova:user>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:project uuid="c30c130e51534270bd374f0315030ffb">tempest-VolumesActionsTest-1741933721</nova:project>
Aug 16 20:01:57 user nova-compute[72894]:       </nova:owner>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:01:57 user nova-compute[72894]:       <nova:ports>
Aug 16 20:01:57 user nova-compute[72894]:         <nova:port uuid="df6bdd29-6be0-4762-b806-03363d4d20ea">
Aug 16 20:01:57 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 20:01:57 user nova-compute[72894]:         </nova:port>
Aug 16 20:01:57 user nova-compute[72894]:       </nova:ports>
Aug 16 20:01:57 user nova-compute[72894]:     </nova:instance>
Aug 16 20:01:57 user nova-compute[72894]:   </metadata>
Aug 16 20:01:57 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:01:57 user nova-compute[72894]:     <system>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="serial">35f08fa1-d2f2-4f51-b588-fbb30f1d5d54</entry>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="uuid">35f08fa1-d2f2-4f51-b588-fbb30f1d5d54</entry>
Aug 16 20:01:57 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:01:57 user nova-compute[72894]:     </system>
Aug 16 20:01:57 user nova-compute[72894]:   </sysinfo>
Aug 16 20:01:57 user nova-compute[72894]:   <os>
Aug 16 20:01:57 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:01:57 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:01:57 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:01:57 user nova-compute[72894]:   </os>
Aug 16 20:01:57 user nova-compute[72894]:   <features>
Aug 16 20:01:57 user nova-compute[72894]:     <acpi/>
Aug 16 20:01:57 user nova-compute[72894]:     <apic/>
Aug 16 20:01:57 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:01:57 user nova-compute[72894]:   </features>
Aug 16 20:01:57 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:01:57 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:01:57 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:01:57 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:01:57 user nova-compute[72894]:   </clock>
Aug 16 20:01:57 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:01:57 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:01:57 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:01:57 user nova-compute[72894]:   </cpu>
Aug 16 20:01:57 user nova-compute[72894]:   <devices>
Aug 16 20:01:57 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:01:57 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:01:57 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk"/>
Aug 16 20:01:57 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:01:57 user nova-compute[72894]:     </disk>
Aug 16 20:01:57 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:01:57 user nova-compute[72894]:       <mac address="fa:16:3e:15:71:35"/>
Aug 16 20:01:57 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:57 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:01:57 user nova-compute[72894]:       <target dev="tapdf6bdd29-6b"/>
Aug 16 20:01:57 user nova-compute[72894]:     </interface>
Aug 16 20:01:57 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:01:57 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/console.log" append="off"/>
Aug 16 20:01:57 user nova-compute[72894]:     </serial>
Aug 16 20:01:57 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:01:57 user nova-compute[72894]:     <video>
Aug 16 20:01:57 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:01:57 user nova-compute[72894]:     </video>
Aug 16 20:01:57 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:01:57 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:01:57 user nova-compute[72894]:     </rng>
Aug 16 20:01:57 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:01:57 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:01:57 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:01:57 user nova-compute[72894]:     </memballoon>
Aug 16 20:01:57 user nova-compute[72894]:   </devices>
Aug 16 20:01:57 user nova-compute[72894]: </domain>
Aug 16 20:01:57 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1390843546',display_name='tempest-VolumesActionsTest-instance-1390843546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1390843546',id=13,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30c130e51534270bd374f0315030ffb',ramdisk_id='',reservation_id='r-xvxzsmux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1741933721',owner_user_name='tempest-VolumesActionsTest-1741933721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:54Z,user_data=None,user_id='4ff8197009d34be7b1aa1ed95f5cf172',uuid=35f08fa1-d2f2-4f51-b588-fbb30f1d5d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converting VIF {"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG os_vif [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf6bdd29-6b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf6bdd29-6b, col_values=(('external_ids', {'iface-id': 'df6bdd29-6be0-4762-b806-03363d4d20ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:71:35', 'vm-uuid': '35f08fa1-d2f2-4f51-b588-fbb30f1d5d54'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:01:57 user nova-compute[72894]: INFO os_vif [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b')
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] No VIF found with MAC fa:16:3e:15:71:35, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-48ed5084-c88d-4721-849f-f03f2394761d req-541144b6-9b0f-4fca-b4e0-47d940e79366 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_resize/disk /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Updated VIF entry in instance network info cache for port df6bdd29-6be0-4762-b806-03363d4d20ea. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Updating instance_info_cache with network_info: [{"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e41a25b1-e0eb-45c1-85cf-17e5fbd28156 req-a977fe38-62de-4854-a825-31e14b4007be service nova] Releasing lock "refresh_cache-35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "cp -r /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_resize/disk /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk" returned: 0 in 0.349s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_resize/disk.info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk.info {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "cp -r /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_resize/disk.info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk.info" returned: 0 in 0.031s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:58 user nova-compute[72894]: WARNING nova.compute.manager [req-0e57e882-3f82-418c-84ed-a99dfe3d0408 req-99bf9ded-32f5-4855-b7c1-4b05588abee8 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state building and task_state spawning.
Aug 16 20:01:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Port 2ea3d08c-315a-4008-917c-b629398a8b98 binding to destination host user is already ACTIVE {{(pid=72894) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:59 user nova-compute[72894]: WARNING nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc for instance with vm_state active and task_state deleting.
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-unplugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-a4bc59a2-9c71-4e21-aab1-c121d6bd6322 req-82953cb9-d7b3-44a4-af0e-bada773f36a3 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-unplugged-41d15a98-37ee-447c-a70e-513bd31d05e8 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG os_brick.utils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c6cfb-c372-487b-a64a-ee3e8fc60396]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b749a-7ede-403c-bba1-7401638f2821]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333f889-2f08-441c-b2c1-1ae02d14887a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6065780-88dc-4db9-8ea7-8a49fb6bee04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:01:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:02:00 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80588ed-5b78-45a5-b19e-0818c8406297]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG os_brick.utils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:00 user nova-compute[72894]: WARNING nova.compute.manager [req-cd8ea319-f9fe-4c67-985a-c41378440ab7 req-26fe8475-3038-44fe-877d-d3a8a9a1bd25 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state building and task_state spawning.
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216120.8837903, 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:00 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] VM Resumed (Lifecycle Event)
Aug 16 20:02:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Instance spawned successfully.
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:00 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216120.8860488, 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:00 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] VM Started (Lifecycle Event)
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:01 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:01 user nova-compute[72894]: INFO nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:01 user nova-compute[72894]: INFO nova.compute.manager [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Took 7.51 seconds to build instance.
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4815475-ac59-49c7-a149-5809f9688f72 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.629s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Acquiring lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] No waiting events found dispatching network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:01 user nova-compute[72894]: WARNING nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received unexpected event network-vif-plugged-41d15a98-37ee-447c-a70e-513bd31d05e8 for instance with vm_state active and task_state deleting.
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-deleted-019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:01 user nova-compute[72894]: INFO nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Neutron deleted interface 019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "address": "fa:16:3e:f1:74:09", "network": {"id": "3729165c-17ef-48d2-b0b7-7bf1b4423d1c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-626006733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0402f95a-9d", "ovs_interfaceid": "0402f95a-9d72-4183-ad59-ba52ddfb8ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Detach interface failed, port_id=019acb8b-ce89-4cc2-bac7-7c6ad3d4be7c, reason: Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-deleted-d74bdb23-3d85-4fc3-bcba-cedb58966818 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:01 user nova-compute[72894]: INFO nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Neutron deleted interface d74bdb23-3d85-4fc3-bcba-cedb58966818; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "3b0566f7-949c-414d-b1ff-91990d9ea863", "address": "fa:16:3e:22:cb:93", "network": {"id": "09000133-548b-4bdb-b126-0e78eedfbb18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-474854089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0566f7-94", "ovs_interfaceid": "3b0566f7-949c-414d-b1ff-91990d9ea863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Detach interface failed, port_id=d74bdb23-3d85-4fc3-bcba-cedb58966818, reason: Instance 54ca09d8-e407-4053-8a27-e318b74211b5 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:01 user nova-compute[72894]: WARNING nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state resize_finish.
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:01 user nova-compute[72894]: WARNING nova.compute.manager [req-896a7384-0b26-42f2-a0fb-7adb30c6849c req-e95dee5b-d647-45bd-83f3-e7946a64fac8 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state resize_finish.
Aug 16 20:02:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-deleted-0402f95a-9d72-4183-ad59-ba52ddfb8ab3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Neutron deleted interface 0402f95a-9d72-4183-ad59-ba52ddfb8ab3; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d15a98-37ee-447c-a70e-513bd31d05e8", "address": "fa:16:3e:fc:65:ad", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d15a98-37", "ovs_interfaceid": "41d15a98-37ee-447c-a70e-513bd31d05e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Detach interface failed, port_id=0402f95a-9d72-4183-ad59-ba52ddfb8ab3, reason: Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-deleted-3b0566f7-949c-414d-b1ff-91990d9ea863 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Neutron deleted interface 3b0566f7-949c-414d-b1ff-91990d9ea863; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25145c72-85a5-4565-9880-593db50b9a9d", "address": "fa:16:3e:11:4f:2c", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25145c72-85", "ovs_interfaceid": "25145c72-85a5-4565-9880-593db50b9a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Detach interface failed, port_id=3b0566f7-949c-414d-b1ff-91990d9ea863, reason: Instance 54ca09d8-e407-4053-8a27-e318b74211b5 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-deleted-25145c72-85a5-4565-9880-593db50b9a9d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Neutron deleted interface 25145c72-85a5-4565-9880-593db50b9a9d; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "address": "fa:16:3e:73:15:7b", "network": {"id": "07f4cfa8-70eb-40b4-bde3-a90122386370", "bridge": "br-int", "label": "tempest-device-tagging-net2-124119757", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap247c5bea-e2", "ovs_interfaceid": "247c5bea-e271-4bab-8241-b1bf4a121f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Detach interface failed, port_id=25145c72-85a5-4565-9880-593db50b9a9d, reason: Instance 54ca09d8-e407-4053-8a27-e318b74211b5 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-deleted-41d15a98-37ee-447c-a70e-513bd31d05e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Neutron deleted interface 41d15a98-37ee-447c-a70e-513bd31d05e8; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "address": "fa:16:3e:74:5c:ce", "network": {"id": "e14da2fd-e727-4148-910c-bdbe6a1b2de3", "bridge": "br-int", "label": "tempest-device-tagging-net2-472832529", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc24ff7-23", "ovs_interfaceid": "0bc24ff7-23fe-4627-b4e9-716376bb1288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Detach interface failed, port_id=41d15a98-37ee-447c-a70e-513bd31d05e8, reason: Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-deleted-0bc24ff7-23fe-4627-b4e9-716376bb1288 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Neutron deleted interface 0bc24ff7-23fe-4627-b4e9-716376bb1288; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [{"id": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "address": "fa:16:3e:29:ac:db", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaadd6e4-92", "ovs_interfaceid": "baadd6e4-92da-47e6-9c23-d8020a9db4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2411431b-e61d-4a10-803d-a64dee4b2c66", "address": "fa:16:3e:67:f5:d6", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2411431b-e6", "ovs_interfaceid": "2411431b-e61d-4a10-803d-a64dee4b2c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "address": "fa:16:3e:9d:03:54", "network": {"id": "d707a7aa-5ad0-47c8-a45a-4c2ae2516e6a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1429781165", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e1f9bc3b28c44328fd761ac44ca82bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65c2a88-d2", "ovs_interfaceid": "a65c2a88-d2e7-4bfd-b12e-752cf16bddbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Detach interface failed, port_id=0bc24ff7-23fe-4627-b4e9-716376bb1288, reason: Instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-deleted-247c5bea-e271-4bab-8241-b1bf4a121f5b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:03 user nova-compute[72894]: INFO nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Neutron deleted interface 247c5bea-e271-4bab-8241-b1bf4a121f5b; detaching it from the instance and deleting it from the info cache
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [{"id": "bef2f44a-5979-4676-b04b-985c6b282de8", "address": "fa:16:3e:f0:6e:45", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef2f44a-59", "ovs_interfaceid": "bef2f44a-5979-4676-b04b-985c6b282de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "address": "fa:16:3e:30:cf:2a", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ed96d7-56", "ovs_interfaceid": "e9ed96d7-56cd-4f08-83ec-3d0ea0a2743a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "address": "fa:16:3e:f8:4a:5d", "network": {"id": "220a6dff-8688-4f32-a063-df8e1a863eb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1646194780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e523c246d424c31ba852e5234f416b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d66-eb", "ovs_interfaceid": "f91b4d66-eb76-4a91-a1f5-0968b3d40615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-7a183620-3755-43d8-815e-1fcb610b6d7b req-8978464e-c24c-4ff8-8346-e4094a557a2e service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Detach interface failed, port_id=247c5bea-e271-4bab-8241-b1bf4a121f5b, reason: Instance 54ca09d8-e407-4053-8a27-e318b74211b5 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:02:03 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:04 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Took 9.08 seconds to deallocate network for instance.
Aug 16 20:02:04 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:04 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Took 8.73 seconds to deallocate network for instance.
Aug 16 20:02:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-92f16385-24ce-402e-9f49-3701e37af495 req-a611bf7b-fe50-445d-a9d7-882444e0f1c6 service nova] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Received event network-vif-deleted-a65c2a88-d2e7-4bfd-b12e-752cf16bddbc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-92f16385-24ce-402e-9f49-3701e37af495 req-a611bf7b-fe50-445d-a9d7-882444e0f1c6 service nova] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Received event network-vif-deleted-f91b4d66-eb76-4a91-a1f5-0968b3d40615 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:05 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216110.816642, 1f02f480-8b2c-42c6-b7e7-bc8d397daa80 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:05 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] VM Stopped (Lifecycle Event)
Aug 16 20:02:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9335fb28-3c99-4047-b589-25c2432c067e None None] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:06 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216111.747342, 54ca09d8-e407-4053-8a27-e318b74211b5 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:06 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] VM Stopped (Lifecycle Event)
Aug 16 20:02:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f1540127-2c38-4b1a-9820-99622386f5d7 None None] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:07 user nova-compute[72894]: INFO nova.compute.manager [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] [instance: 54ca09d8-e407-4053-8a27-e318b74211b5] Took 3.21 seconds to detach 3 volumes for instance.
Aug 16 20:02:07 user nova-compute[72894]: INFO nova.compute.manager [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] [instance: 1f02f480-8b2c-42c6-b7e7-bc8d397daa80] Took 3.26 seconds to detach 3 volumes for instance.
Aug 16 20:02:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.483s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:07 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Deleted allocations for instance 54ca09d8-e407-4053-8a27-e318b74211b5
Aug 16 20:02:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bc3436c3-d4dc-44c4-8c5c-be6e8fb31e37 tempest-TaggedBootDevicesTest-166088539 tempest-TaggedBootDevicesTest-166088539-project-member] Lock "54ca09d8-e407-4053-8a27-e318b74211b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.938s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:08 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:08 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:08 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Deleted allocations for instance 1f02f480-8b2c-42c6-b7e7-bc8d397daa80
Aug 16 20:02:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a4df4be1-606d-4647-add4-015ea7c0cb46 tempest-TaggedBootDevicesTest_v242-378966607 tempest-TaggedBootDevicesTest_v242-378966607-project-member] Lock "1f02f480-8b2c-42c6-b7e7-bc8d397daa80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.771s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:11 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216116.5881946, 12dd204d-9368-47c2-88e2-8d97ff942621 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:11 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Stopped (Lifecycle Event)
Aug 16 20:02:11 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6ae9442d-3853-48a6-882d-f9b454f7c43d None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:11 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6ae9442d-3853-48a6-882d-f9b454f7c43d None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:11 user nova-compute[72894]: INFO nova.compute.manager [None req-6ae9442d-3853-48a6-882d-f9b454f7c43d None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:02:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Starting finish_migration {{(pid=72894) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 20:02:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:02:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Creating image(s)
Aug 16 20:02:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk. size=21474836480 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk 21474836480 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk 21474836480" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Ensure instance console log exists: /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start _get_guest_xml network_info=[{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '88279cfa-b09c-442a-a802-eb7bc80dcfc5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '12dd204d-9368-47c2-88e2-8d97ff942621', 'attached_at': '2023-08-16T20:02:13.000000', 'detached_at': '', 'volume_id': '91f3c5f5-09ab-464c-9d18-53e44b97f616', 'serial': '91f3c5f5-09ab-464c-9d18-53e44b97f616'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:02:13 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:13 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:02:13 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:02:13 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:02:13 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db0f16-23c7-4781-953f-8b399506f7fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:02:13 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4486a5e-8914-4015-a480-2ca17ae183ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec159c-0896-4ee6-b027-9b2090d3bab7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf81b5d-07ec-45a4-a6e0-3303b9f3461c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bda6bc-e5fb-44c6-93af-75fc57f28168]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTxWSRoZ'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d8f022-1e87-4d58-9753-3c539ed0f95a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445bd71-6c2f-4cf2-8017-d9fd07f91e6f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c71b27a-a2bc-4d8f-805b-82c8d27c791d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:02:13 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f7081-8535-4d12-931f-14589fb3b66d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fb3b3-3e4c-4036-a1f9-afbdbf512915]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:02:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:02:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc565630-9254-46bb-a9b4-bec65145a457]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:14 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:02:14 user nova-compute[72894]: INFO nova.compute.claims [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Claim successful on node user
Aug 16 20:02:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:02:15 user nova-compute[72894]:   <uuid>12dd204d-9368-47c2-88e2-8d97ff942621</uuid>
Aug 16 20:02:15 user nova-compute[72894]:   <name>instance-00000002</name>
Aug 16 20:02:15 user nova-compute[72894]:   <memory>2097152</memory>
Aug 16 20:02:15 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:02:15 user nova-compute[72894]:   <metadata>
Aug 16 20:02:15 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:02:15 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherB-server-1557906681</nova:name>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:02:13</nova:creationTime>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:flavor name="m1.small">
Aug 16 20:02:15 user nova-compute[72894]:         <nova:memory>2048</nova:memory>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:disk>20</nova:disk>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:02:15 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:owner>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:user uuid="a82f6efbf71343eca3f5b09517d3a86d">tempest-ServerActionsTestOtherB-85778765-project-member</nova:user>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:project uuid="71a2a663816647aa9bb26ac44848f40e">tempest-ServerActionsTestOtherB-85778765</nova:project>
Aug 16 20:02:15 user nova-compute[72894]:       </nova:owner>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:02:15 user nova-compute[72894]:       <nova:ports>
Aug 16 20:02:15 user nova-compute[72894]:         <nova:port uuid="2ea3d08c-315a-4008-917c-b629398a8b98">
Aug 16 20:02:15 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:02:15 user nova-compute[72894]:         </nova:port>
Aug 16 20:02:15 user nova-compute[72894]:       </nova:ports>
Aug 16 20:02:15 user nova-compute[72894]:     </nova:instance>
Aug 16 20:02:15 user nova-compute[72894]:   </metadata>
Aug 16 20:02:15 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:02:15 user nova-compute[72894]:     <system>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="serial">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="uuid">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 20:02:15 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:02:15 user nova-compute[72894]:     </system>
Aug 16 20:02:15 user nova-compute[72894]:   </sysinfo>
Aug 16 20:02:15 user nova-compute[72894]:   <os>
Aug 16 20:02:15 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:02:15 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:02:15 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:02:15 user nova-compute[72894]:   </os>
Aug 16 20:02:15 user nova-compute[72894]:   <features>
Aug 16 20:02:15 user nova-compute[72894]:     <acpi/>
Aug 16 20:02:15 user nova-compute[72894]:     <apic/>
Aug 16 20:02:15 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:02:15 user nova-compute[72894]:   </features>
Aug 16 20:02:15 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:02:15 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:02:15 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:02:15 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:02:15 user nova-compute[72894]:   </clock>
Aug 16 20:02:15 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:02:15 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:02:15 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:02:15 user nova-compute[72894]:   </cpu>
Aug 16 20:02:15 user nova-compute[72894]:   <devices>
Aug 16 20:02:15 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:02:15 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:02:15 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk"/>
Aug 16 20:02:15 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:02:15 user nova-compute[72894]:     </disk>
Aug 16 20:02:15 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:02:15 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:02:15 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:02:15 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:02:15 user nova-compute[72894]:       <serial>91f3c5f5-09ab-464c-9d18-53e44b97f616</serial>
Aug 16 20:02:15 user nova-compute[72894]:     </disk>
Aug 16 20:02:15 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:02:15 user nova-compute[72894]:       <mac address="fa:16:3e:30:37:0b"/>
Aug 16 20:02:15 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:15 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:02:15 user nova-compute[72894]:       <target dev="tap2ea3d08c-31"/>
Aug 16 20:02:15 user nova-compute[72894]:     </interface>
Aug 16 20:02:15 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:02:15 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/console.log" append="off"/>
Aug 16 20:02:15 user nova-compute[72894]:     </serial>
Aug 16 20:02:15 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:02:15 user nova-compute[72894]:     <video>
Aug 16 20:02:15 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:15 user nova-compute[72894]:     </video>
Aug 16 20:02:15 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:02:15 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:02:15 user nova-compute[72894]:     </rng>
Aug 16 20:02:15 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:02:15 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:02:15 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:02:15 user nova-compute[72894]:     </memballoon>
Aug 16 20:02:15 user nova-compute[72894]:   </devices>
Aug 16 20:02:15 user nova-compute[72894]: </domain>
Aug 16 20:02:15 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1506989657-network", "vif_mac": "fa:16:3e:30:37:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG os_vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea3d08c-31, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ea3d08c-31, col_values=(('external_ids', {'iface-id': '2ea3d08c-315a-4008-917c-b629398a8b98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:37:0b', 'vm-uuid': '12dd204d-9368-47c2-88e2-8d97ff942621'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:15 user nova-compute[72894]: INFO os_vif [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] No VIF found with MAC fa:16:3e:30:37:0b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:02:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:02:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Creating image(s)
Aug 16 20:02:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "/opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "/opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "/opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:15 user nova-compute[72894]: DEBUG nova.policy [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6a1f78a8b054f0b84c5bcbc1fa8c286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd50fd8a7134bb2882624b5a221cfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.269s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk 1073741824" returned: 0 in 0.066s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Cannot resize image /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'migration_context' on Instance uuid 280e6782-15c7-4a5d-8026-716edb653428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Ensure instance console log exists: /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:17 user nova-compute[72894]: WARNING nova.compute.manager [req-e1b14554-8479-46ff-a8f7-bb5494e6c1df req-da4421c0-5bf8-4021-af6e-6b7090a1b9c5 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state resize_finish.
Aug 16 20:02:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Successfully created port: 82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216139.068755, 12dd204d-9368-47c2-88e2-8d97ff942621 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:19 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Resumed (Lifecycle Event)
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:02:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance running successfully.
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Failed to set time: agent not configured {{(pid=72894) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ec061278-7190-463a-ab58-d000fd1e5120 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] finish_migration finished successfully. {{(pid=72894) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:19 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216139.0706499, 12dd204d-9368-47c2-88e2-8d97ff942621 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:19 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Started (Lifecycle Event)
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:19 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:19 user nova-compute[72894]: WARNING nova.compute.manager [req-5e57009b-9d57-4851-9d6f-f9e4cad252d3 req-72ac4f56-8698-4968-85f1-a3b58f7c10c2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state resize_finish.
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Successfully updated port: 82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquired lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:20 user nova-compute[72894]: INFO nova.compute.manager [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Rescuing
Aug 16 20:02:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Updating instance_info_cache with network_info: [{"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Releasing lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Instance network_info: |[{"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Start _get_guest_xml network_info=[{"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:02:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1765606280',display_name='tempest-VolumesActionsTest-instance-1765606280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1765606280',id=14,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-ry1vjm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:16Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=280e6782-15c7-4a5d-8026-716edb653428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'pci_devices' on Instance uuid 280e6782-15c7-4a5d-8026-716edb653428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:02:20 user nova-compute[72894]:   <uuid>280e6782-15c7-4a5d-8026-716edb653428</uuid>
Aug 16 20:02:20 user nova-compute[72894]:   <name>instance-0000000e</name>
Aug 16 20:02:20 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:02:20 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:02:20 user nova-compute[72894]:   <metadata>
Aug 16 20:02:20 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:02:20 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:name>tempest-VolumesActionsTest-instance-1765606280</nova:name>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:02:20</nova:creationTime>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:02:20 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:02:20 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:owner>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:user uuid="e6a1f78a8b054f0b84c5bcbc1fa8c286">tempest-VolumesActionsTest-448586114-project-member</nova:user>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:project uuid="fcd50fd8a7134bb2882624b5a221cfa1">tempest-VolumesActionsTest-448586114</nova:project>
Aug 16 20:02:20 user nova-compute[72894]:       </nova:owner>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:02:20 user nova-compute[72894]:       <nova:ports>
Aug 16 20:02:20 user nova-compute[72894]:         <nova:port uuid="82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc">
Aug 16 20:02:20 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 20:02:20 user nova-compute[72894]:         </nova:port>
Aug 16 20:02:20 user nova-compute[72894]:       </nova:ports>
Aug 16 20:02:20 user nova-compute[72894]:     </nova:instance>
Aug 16 20:02:20 user nova-compute[72894]:   </metadata>
Aug 16 20:02:20 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:02:20 user nova-compute[72894]:     <system>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="serial">280e6782-15c7-4a5d-8026-716edb653428</entry>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="uuid">280e6782-15c7-4a5d-8026-716edb653428</entry>
Aug 16 20:02:20 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:02:20 user nova-compute[72894]:     </system>
Aug 16 20:02:20 user nova-compute[72894]:   </sysinfo>
Aug 16 20:02:20 user nova-compute[72894]:   <os>
Aug 16 20:02:20 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:02:20 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:02:20 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:02:20 user nova-compute[72894]:   </os>
Aug 16 20:02:20 user nova-compute[72894]:   <features>
Aug 16 20:02:20 user nova-compute[72894]:     <acpi/>
Aug 16 20:02:20 user nova-compute[72894]:     <apic/>
Aug 16 20:02:20 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:02:20 user nova-compute[72894]:   </features>
Aug 16 20:02:20 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:02:20 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:02:20 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:02:20 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:02:20 user nova-compute[72894]:   </clock>
Aug 16 20:02:20 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:02:20 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:02:20 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:02:20 user nova-compute[72894]:   </cpu>
Aug 16 20:02:20 user nova-compute[72894]:   <devices>
Aug 16 20:02:20 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:02:20 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:02:20 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk"/>
Aug 16 20:02:20 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:02:20 user nova-compute[72894]:     </disk>
Aug 16 20:02:20 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:02:20 user nova-compute[72894]:       <mac address="fa:16:3e:59:b0:c5"/>
Aug 16 20:02:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:20 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:02:20 user nova-compute[72894]:       <target dev="tap82e2d785-eb"/>
Aug 16 20:02:20 user nova-compute[72894]:     </interface>
Aug 16 20:02:20 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:02:20 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/console.log" append="off"/>
Aug 16 20:02:20 user nova-compute[72894]:     </serial>
Aug 16 20:02:20 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:02:20 user nova-compute[72894]:     <video>
Aug 16 20:02:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:20 user nova-compute[72894]:     </video>
Aug 16 20:02:20 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:02:20 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:02:20 user nova-compute[72894]:     </rng>
Aug 16 20:02:20 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:02:20 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:02:20 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:02:20 user nova-compute[72894]:     </memballoon>
Aug 16 20:02:20 user nova-compute[72894]:   </devices>
Aug 16 20:02:20 user nova-compute[72894]: </domain>
Aug 16 20:02:20 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1765606280',display_name='tempest-VolumesActionsTest-instance-1765606280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1765606280',id=14,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-ry1vjm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:16Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=280e6782-15c7-4a5d-8026-716edb653428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG os_vif [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82e2d785-eb, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82e2d785-eb, col_values=(('external_ids', {'iface-id': '82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b0:c5', 'vm-uuid': '280e6782-15c7-4a5d-8026-716edb653428'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:20 user nova-compute[72894]: INFO os_vif [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb')
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] No VIF found with MAC fa:16:3e:59:b0:c5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-changed-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Refreshing instance network info cache due to event network-changed-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] Acquiring lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] Acquired lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Refreshing network info cache for port 82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Updated VIF entry in instance network info cache for port 82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Updating instance_info_cache with network_info: [{"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da580dd1-45da-416f-a817-e77a5442ac1d req-d60d8df1-c9ff-4686-8ae0-f0021165745c service nova] Releasing lock "refresh_cache-280e6782-15c7-4a5d-8026-716edb653428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance destroyed successfully.
Aug 16 20:02:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Attempting a stable device rescue
Aug 16 20:02:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:02:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Creating image(s)
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'trusted_certs' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:24 user nova-compute[72894]: WARNING nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state active and task_state rescuing.
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:24 user nova-compute[72894]: WARNING nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state active and task_state rescuing.
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] No waiting events found dispatching network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:24 user nova-compute[72894]: WARNING nova.compute.manager [req-46daffda-10b8-438f-ab5c-96543dd73f23 req-433cbed5-edca-4693-a72a-43198e0213fa service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received unexpected event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc for instance with vm_state building and task_state spawning.
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.virt.images [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] 4f098895-b479-46f9-8c75-5a64887596c2 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:02:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.part /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.part /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.converted" returned: 0 in 0.476s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.807s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] No waiting events found dispatching network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:25 user nova-compute[72894]: WARNING nova.compute.manager [req-5fee1a85-742a-48cc-9420-562a3b962e6c req-895860a7-93d2-48b3-ab7e-342c21fbf0e6 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received unexpected event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc for instance with vm_state building and task_state spawning.
Aug 16 20:02:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242 --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242,backing_fmt=raw /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242,backing_fmt=raw /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue" returned: 0 in 0.059s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "bfbc74493d355a9aeec084fd3ab34282a1bee242" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'migration_context' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start _get_guest_xml network_info=[{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:24:08:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f098895-b479-46f9-8c75-5a64887596c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b2ff84ed-56ca-4da7-bf52-955027ecb0c9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '133d92d6-70ca-4d7e-90d1-4edd276e716f', 'attached_at': '', 'detached_at': '', 'volume_id': '4678fdb8-71ab-4318-bdfc-f7382f737350', 'serial': '4678fdb8-71ab-4318-bdfc-f7382f737350'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'numa_topology' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:02:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'vcpu_model' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:02:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:02:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:02:26 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023a6e0-2ce7-4816-9140-2c1703b5089a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NIwegxKf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 20:02:26 user nova-compute[72894]: node.name = iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350
Aug 16 20:02:26 user nova-compute[72894]: node.tpgt = -1
Aug 16 20:02:26 user nova-compute[72894]: node.startup = automatic
Aug 16 20:02:26 user nova-compute[72894]: node.leading_login = No
Aug 16 20:02:26 user nova-compute[72894]: iface.iscsi_ifacename = default
Aug 16 20:02:26 user nova-compute[72894]: iface.net_ifacename = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.ipaddress = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.prefix_len = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.hwaddress = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.transport_name = tcp
Aug 16 20:02:26 user nova-compute[72894]: iface.initiatorname = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.vlan_id = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.vlan_priority = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.vlan_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.iface_num = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.mtu = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.port = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.bootproto = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.subnet_mask = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.gateway = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_alt_client_id = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_dns = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_learn_iqn = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_vendor_id_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_vendor_id = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.dhcp_slp_da = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.fragmentation = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.gratuitous_arp = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.incoming_forwarding = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.tos_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.tos = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.ttl = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.delayed_ack = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.tcp_nagle = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.tcp_wsf_state = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.tcp_wsf = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.tcp_timer_scale = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.tcp_timestamp = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.redirect = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.def_task_mgmt_timeout = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.header_digest = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.data_digest = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.immediate_data = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.initial_r2t = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.data_seq_inorder = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.data_pdu_inorder = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.erl = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.max_receive_data_len = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.first_burst_len = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.max_outstanding_r2t = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.max_burst_len = 0
Aug 16 20:02:26 user nova-compute[72894]: iface.chap_auth = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.bidi_chap = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.strict_login_compliance = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.discovery_auth = <empty>
Aug 16 20:02:26 user nova-compute[72894]: iface.discovery_logout = <empty>
Aug 16 20:02:26 user nova-compute[72894]: node.discovery_address = <empty>
Aug 16 20:02:26 user nova-compute[72894]: node.discovery_port = 0
Aug 16 20:02:26 user nova-compute[72894]: node.discovery_type = static
Aug 16 20:02:26 user nova-compute[72894]: node.session.initial_cmdsn = 0
Aug 16 20:02:26 user nova-compute[72894]: node.session.initial_login_retry_max = 8
Aug 16 20:02:26 user nova-compute[72894]: node.session.xmit_thread_priority = -20
Aug 16 20:02:26 user nova-compute[72894]: node.session.cmds_max = 128
Aug 16 20:02:26 user nova-compute[72894]: node.session.queue_depth = 32
Aug 16 20:02:26 user nova-compute[72894]: node.session.nr_sessions = 1
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.authmethod = CHAP
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.username = NIwegxKf
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.password = ***
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.username_in = <empty>
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.password_in = <empty>
Aug 16 20:02:26 user nova-compute[72894]: node.session.auth.chap_algs = MD5
Aug 16 20:02:26 user nova-compute[72894]: node.session.timeo.replacement_timeout = 120
Aug 16 20:02:26 user nova-compute[72894]: node.session.err_timeo.abort_timeout = 15
Aug 16 20:02:26 user nova-compute[72894]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 20:02:26 user nova-compute[72894]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 20:02:26 user nova-compute[72894]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.FastAbort = Yes
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.InitialR2T = No
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.ImmediateData = Yes
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.MaxConnections = 1
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 20:02:26 user nova-compute[72894]: node.session.iscsi.ERL = 0
Aug 16 20:02:26 user nova-compute[72894]: node.session.scan = manual
Aug 16 20:02:26 user nova-compute[72894]: node.session.reopen_max = 0
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].address = 172.16.0.220
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].port = 3260
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].startup = manual
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].tcp.window_size = 524288
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].tcp.type_of_service = 0
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].timeo.logout_timeout = 15
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].timeo.login_timeout = 15
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].timeo.auth_timeout = 45
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.DataDigest = None
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.IFMarker = No
Aug 16 20:02:26 user nova-compute[72894]: node.conn[0].iscsi.OFMarker = No
Aug 16 20:02:26 user nova-compute[72894]: # END RECORD
Aug 16 20:02:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2679e-6237-4355-859f-9d1038437365]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b4b97-32c8-4417-b8b4-03b6a3908694]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIwegxKf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIwegxKf" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[63153eaf-97a7-437e-a3a4-2188b8438073]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIwegxKf'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d862ec-b4ec-42ae-9777-88235812b247]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dcf0a1-06e7-45ec-a189-077fffeab375]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:02:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.192s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] HCTL ('39', '0', '0', 0) found on session 11 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41b7b8-8499-4966-8953-9ce2328687d8]: (4, ('0 0 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching for a device in session 11 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== connect_volume: return (222ms) {'type': 'block', 'scsi_wwn': '26138643337346363', 'path': '/dev/sdh'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138643337346363', 'path': '/dev/sdh'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1386601857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1386601857',id=10,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-0wa2lq9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:00:54Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=133d92d6-70ca-4d7e-90d1-4edd276e716f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:24:08:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:24:08:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:02:26 user nova-compute[72894]:   <uuid>133d92d6-70ca-4d7e-90d1-4edd276e716f</uuid>
Aug 16 20:02:26 user nova-compute[72894]:   <name>instance-0000000a</name>
Aug 16 20:02:26 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:02:26 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:02:26 user nova-compute[72894]:   <metadata>
Aug 16 20:02:26 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:02:26 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1386601857</nova:name>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:02:25</nova:creationTime>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:02:26 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:02:26 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:owner>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 20:02:26 user nova-compute[72894]:       </nova:owner>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:02:26 user nova-compute[72894]:       <nova:ports>
Aug 16 20:02:26 user nova-compute[72894]:         <nova:port uuid="721c25e7-589b-4efc-9922-305a60a69af1">
Aug 16 20:02:26 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:02:26 user nova-compute[72894]:         </nova:port>
Aug 16 20:02:26 user nova-compute[72894]:       </nova:ports>
Aug 16 20:02:26 user nova-compute[72894]:     </nova:instance>
Aug 16 20:02:26 user nova-compute[72894]:   </metadata>
Aug 16 20:02:26 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:02:26 user nova-compute[72894]:     <system>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="serial">133d92d6-70ca-4d7e-90d1-4edd276e716f</entry>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="uuid">133d92d6-70ca-4d7e-90d1-4edd276e716f</entry>
Aug 16 20:02:26 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:02:26 user nova-compute[72894]:     </system>
Aug 16 20:02:26 user nova-compute[72894]:   </sysinfo>
Aug 16 20:02:26 user nova-compute[72894]:   <os>
Aug 16 20:02:26 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:02:26 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:02:26 user nova-compute[72894]:   </os>
Aug 16 20:02:26 user nova-compute[72894]:   <features>
Aug 16 20:02:26 user nova-compute[72894]:     <acpi/>
Aug 16 20:02:26 user nova-compute[72894]:     <apic/>
Aug 16 20:02:26 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:02:26 user nova-compute[72894]:   </features>
Aug 16 20:02:26 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:02:26 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:02:26 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:02:26 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:02:26 user nova-compute[72894]:   </clock>
Aug 16 20:02:26 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:02:26 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:02:26 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:02:26 user nova-compute[72894]:   </cpu>
Aug 16 20:02:26 user nova-compute[72894]:   <devices>
Aug 16 20:02:26 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:02:26 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:02:26 user nova-compute[72894]:       <source dev="/dev/sdh"/>
Aug 16 20:02:26 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:02:26 user nova-compute[72894]:       <serial>4678fdb8-71ab-4318-bdfc-f7382f737350</serial>
Aug 16 20:02:26 user nova-compute[72894]:     </disk>
Aug 16 20:02:26 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:02:26 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:02:26 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue"/>
Aug 16 20:02:26 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:02:26 user nova-compute[72894]:       <boot order="1"/>
Aug 16 20:02:26 user nova-compute[72894]:     </disk>
Aug 16 20:02:26 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:02:26 user nova-compute[72894]:       <mac address="fa:16:3e:24:08:74"/>
Aug 16 20:02:26 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:26 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:02:26 user nova-compute[72894]:       <target dev="tap721c25e7-58"/>
Aug 16 20:02:26 user nova-compute[72894]:     </interface>
Aug 16 20:02:26 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:02:26 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/console.log" append="off"/>
Aug 16 20:02:26 user nova-compute[72894]:     </serial>
Aug 16 20:02:26 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:02:26 user nova-compute[72894]:     <video>
Aug 16 20:02:26 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:26 user nova-compute[72894]:     </video>
Aug 16 20:02:26 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:02:26 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:02:26 user nova-compute[72894]:     </rng>
Aug 16 20:02:26 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:02:26 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:02:26 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:02:26 user nova-compute[72894]:     </memballoon>
Aug 16 20:02:26 user nova-compute[72894]:   </devices>
Aug 16 20:02:26 user nova-compute[72894]: </domain>
Aug 16 20:02:26 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance destroyed successfully.
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216146.3436964, 280e6782-15c7-4a5d-8026-716edb653428 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] VM Resumed (Lifecycle Event)
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Instance spawned successfully.
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:24:08:74, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216146.3468008, 280e6782-15c7-4a5d-8026-716edb653428 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] VM Started (Lifecycle Event)
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Took 10.77 seconds to spawn the instance on the hypervisor.
Aug 16 20:02:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:26 user nova-compute[72894]: INFO nova.compute.manager [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Took 11.90 seconds to build instance.
Aug 16 20:02:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3a7d8be0-947b-4ddc-886d-d981d9b8078f tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.051s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:28 user nova-compute[72894]: WARNING nova.compute.manager [req-41277642-9271-4b05-8aa3-e3a88284efa8 req-affee896-fd61-4c5e-851f-eabb93d7ea5e service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state active and task_state rescuing.
Aug 16 20:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:30 user nova-compute[72894]: WARNING nova.compute.manager [req-481c1e4b-07e8-4280-866f-a67d697b21e2 req-eab75964-2bc5-4f58-93cb-078512145ac1 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state active and task_state rescuing.
Aug 16 20:02:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 133d92d6-70ca-4d7e-90d1-4edd276e716f due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216150.5901182, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:30 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Resumed (Lifecycle Event)
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7448451d-3381-4d07-bc0e-b2c5dcf37ccb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:30 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216150.5958204, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:30 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Started (Lifecycle Event)
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:02:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:02:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:02:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=24.579612731933594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Applying migration context for instance 12dd204d-9368-47c2-88e2-8d97ff942621 as it has an incoming, in-progress migration ff1d0b0a-f652-492b-aca0-618c134935e3. Migration status is finished {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 20:02:37 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating resource usage from migration ff1d0b0a-f652-492b-aca0-618c134935e3
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Migration ff1d0b0a-f652-492b-aca0-618c134935e3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 280e6782-15c7-4a5d-8026-716edb653428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:02:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:02:38 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:02:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:02:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:02:49 user nova-compute[72894]: INFO nova.compute.claims [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Claim successful on node user
Aug 16 20:02:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:02:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.policy [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '387415e40279468eaf69c06b271be2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a14259280244b3ad64ea5fb30ce7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:02:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Creating image(s)
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.261s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk 1073741824" returned: 0 in 0.061s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Successfully created port: 811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.236s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Cannot resize image /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'migration_context' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Ensure instance console log exists: /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Successfully updated port: 811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing instance network info cache due to event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:51 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance network_info: |[{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start _get_guest_xml network_info=[{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:02:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuRbQ6N07kpVQdNWXxKjjhMnNk8l82FaLiXr7JemPfFPYqUm9+8nVNBPG07c5ZLgZyLfQpN2/vZy3mSP/uw9M0RWzh6GGwT9FqyP0Qt3bq3eM5XA/m3HXHkAhEIMNJUPw==',key_name='tempest-keypair-480767158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_devices' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:02:52 user nova-compute[72894]:   <uuid>2073e7a0-b213-44da-9249-47ace2f78b84</uuid>
Aug 16 20:02:52 user nova-compute[72894]:   <name>instance-0000000f</name>
Aug 16 20:02:52 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:02:52 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:02:52 user nova-compute[72894]:   <metadata>
Aug 16 20:02:52 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:02:52 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1228818073</nova:name>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:02:52</nova:creationTime>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:02:52 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:02:52 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:owner>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:user uuid="387415e40279468eaf69c06b271be2c9">tempest-AttachVolumeShelveTestJSON-1527512383-project-member</nova:user>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:project uuid="53a14259280244b3ad64ea5fb30ce7bf">tempest-AttachVolumeShelveTestJSON-1527512383</nova:project>
Aug 16 20:02:52 user nova-compute[72894]:       </nova:owner>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:02:52 user nova-compute[72894]:       <nova:ports>
Aug 16 20:02:52 user nova-compute[72894]:         <nova:port uuid="811bf633-15a4-4a39-8270-e8b54399cbed">
Aug 16 20:02:52 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:02:52 user nova-compute[72894]:         </nova:port>
Aug 16 20:02:52 user nova-compute[72894]:       </nova:ports>
Aug 16 20:02:52 user nova-compute[72894]:     </nova:instance>
Aug 16 20:02:52 user nova-compute[72894]:   </metadata>
Aug 16 20:02:52 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:02:52 user nova-compute[72894]:     <system>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="serial">2073e7a0-b213-44da-9249-47ace2f78b84</entry>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="uuid">2073e7a0-b213-44da-9249-47ace2f78b84</entry>
Aug 16 20:02:52 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:02:52 user nova-compute[72894]:     </system>
Aug 16 20:02:52 user nova-compute[72894]:   </sysinfo>
Aug 16 20:02:52 user nova-compute[72894]:   <os>
Aug 16 20:02:52 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:02:52 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:02:52 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:02:52 user nova-compute[72894]:   </os>
Aug 16 20:02:52 user nova-compute[72894]:   <features>
Aug 16 20:02:52 user nova-compute[72894]:     <acpi/>
Aug 16 20:02:52 user nova-compute[72894]:     <apic/>
Aug 16 20:02:52 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:02:52 user nova-compute[72894]:   </features>
Aug 16 20:02:52 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:02:52 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:02:52 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:02:52 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:02:52 user nova-compute[72894]:   </clock>
Aug 16 20:02:52 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:02:52 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:02:52 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:02:52 user nova-compute[72894]:   </cpu>
Aug 16 20:02:52 user nova-compute[72894]:   <devices>
Aug 16 20:02:52 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:02:52 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:02:52 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk"/>
Aug 16 20:02:52 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:02:52 user nova-compute[72894]:     </disk>
Aug 16 20:02:52 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:02:52 user nova-compute[72894]:       <mac address="fa:16:3e:c7:9a:b8"/>
Aug 16 20:02:52 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:52 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:02:52 user nova-compute[72894]:       <target dev="tap811bf633-15"/>
Aug 16 20:02:52 user nova-compute[72894]:     </interface>
Aug 16 20:02:52 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:02:52 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/console.log" append="off"/>
Aug 16 20:02:52 user nova-compute[72894]:     </serial>
Aug 16 20:02:52 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:02:52 user nova-compute[72894]:     <video>
Aug 16 20:02:52 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:02:52 user nova-compute[72894]:     </video>
Aug 16 20:02:52 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:02:52 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:02:52 user nova-compute[72894]:     </rng>
Aug 16 20:02:52 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:02:52 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:02:52 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:02:52 user nova-compute[72894]:     </memballoon>
Aug 16 20:02:52 user nova-compute[72894]:   </devices>
Aug 16 20:02:52 user nova-compute[72894]: </domain>
Aug 16 20:02:52 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuRbQ6N07kpVQdNWXxKjjhMnNk8l82FaLiXr7JemPfFPYqUm9+8nVNBPG07c5ZLgZyLfQpN2/vZy3mSP/uw9M0RWzh6GGwT9FqyP0Qt3bq3eM5XA/m3HXHkAhEIMNJUPw==',key_name='tempest-keypair-480767158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG os_vif [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap811bf633-15, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap811bf633-15, col_values=(('external_ids', {'iface-id': '811bf633-15a4-4a39-8270-e8b54399cbed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:9a:b8', 'vm-uuid': '2073e7a0-b213-44da-9249-47ace2f78b84'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:52 user nova-compute[72894]: INFO os_vif [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15')
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No VIF found with MAC fa:16:3e:c7:9a:b8, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updated VIF entry in instance network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f11bc07d-0005-4ea4-bcbf-75f53c5dcfd5 req-fe0c9d3b-9829-4df3-a536-b6a8738e8013 service nova] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:54 user nova-compute[72894]: WARNING nova.compute.manager [req-04a617f4-511d-4867-b801-8a735ba0ff9a req-4b45ba48-163f-49f3-90eb-7745bb01252c service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state building and task_state spawning.
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:02:55 user nova-compute[72894]: INFO nova.compute.claims [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Claim successful on node user
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:02:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.policy [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bebd9cb0f85b44498beafbbb256b68be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf0814c43b248be85d1a2db26870976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:02:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Creating image(s)
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "/opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "/opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.claims [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Claim successful on node user
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing instance network info cache due to event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.network.neutron [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216176.3598723, 2073e7a0-b213-44da-9249-47ace2f78b84 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Resumed (Lifecycle Event)
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk 1073741824" returned: 0 in 0.072s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance spawned successfully.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:56 user nova-compute[72894]: WARNING nova.compute.manager [req-350bdabf-b6cd-473e-a0d9-d89a2c5f9ec6 req-0606dcd2-0661-4571-a13f-a2f1950b7f13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state building and task_state spawning.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216176.3609824, 2073e7a0-b213-44da-9249-47ace2f78b84 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Started (Lifecycle Event)
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.219s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Took 7.23 seconds to build instance.
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3faad70b-5a80-44b0-bbcf-90750a0b9c9d tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.328s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.783s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Cannot resize image /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'migration_context' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Ensure instance console log exists: /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.compute.manager [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Shelve offloading
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:02:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:02:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.policy [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:02:57 user nova-compute[72894]: INFO nova.virt.block_device [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Booting with volume snapshot bcb16b40-9cca-405d-944f-791b0ffc3fbb at /dev/vda
Aug 16 20:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Successfully created port: df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:02:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance destroyed successfully.
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Successfully created port: c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated VIF entry in instance network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c014e7ac-a2f1-4a15-a669-c652b851230b req-8362e0a4-4cd2-42c1-acfe-e753544e9c2a service nova] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:58 user nova-compute[72894]: WARNING nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state active and task_state shelving.
Aug 16 20:02:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:02:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:02:58 user nova-compute[72894]: WARNING nova.compute.manager [req-1555f106-8d36-4604-a7cd-f354a46173fa req-ce436717-cf46-4556-be42-fb575c5ce095 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state active and task_state shelving.
Aug 16 20:02:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Successfully updated port: c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-changed-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Refreshing instance network info cache due to event network-changed-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] Acquiring lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Updating instance_info_cache with network_info: [{"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Instance network_info: |[{"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] Acquired lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Refreshing network info cache for port c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Successfully updated port: df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquired lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:02:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updating instance_info_cache with network_info: [{"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Releasing lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Instance network_info: |[{"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Start _get_guest_xml network_info=[{"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:03:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1834134842',display_name='tempest-TestVolumeSwap-server-1834134842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1834134842',id=16,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnA22GQypd5ohEWUDbaltdiUGAzD/EBDX4fxSADK4RYBm+4rS/N1pEGLsFwkdzrHp2J88S3bCat2C5sjwkR9bw31XkoXMdZ22uvfTKkyi/DoLM/jQm+oqewXom1cnfHAw==',key_name='tempest-keypair-1156483859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf0814c43b248be85d1a2db26870976',ramdisk_id='',reservation_id='r-knpm6s1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1153771719',owner_user_name='tempest-TestVolumeSwap-1153771719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bebd9cb0f85b44498beafbbb256b68be',uuid=7b2c0761-d8f9-411b-8df7-9f79795029fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converting VIF {"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:03:00 user nova-compute[72894]:   <uuid>7b2c0761-d8f9-411b-8df7-9f79795029fd</uuid>
Aug 16 20:03:00 user nova-compute[72894]:   <name>instance-00000010</name>
Aug 16 20:03:00 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:03:00 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:03:00 user nova-compute[72894]:   <metadata>
Aug 16 20:03:00 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:03:00 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:name>tempest-TestVolumeSwap-server-1834134842</nova:name>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:03:00</nova:creationTime>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:03:00 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:03:00 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:owner>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:user uuid="bebd9cb0f85b44498beafbbb256b68be">tempest-TestVolumeSwap-1153771719-project-member</nova:user>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:project uuid="cbf0814c43b248be85d1a2db26870976">tempest-TestVolumeSwap-1153771719</nova:project>
Aug 16 20:03:00 user nova-compute[72894]:       </nova:owner>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:03:00 user nova-compute[72894]:       <nova:ports>
Aug 16 20:03:00 user nova-compute[72894]:         <nova:port uuid="df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6">
Aug 16 20:03:00 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:03:00 user nova-compute[72894]:         </nova:port>
Aug 16 20:03:00 user nova-compute[72894]:       </nova:ports>
Aug 16 20:03:00 user nova-compute[72894]:     </nova:instance>
Aug 16 20:03:00 user nova-compute[72894]:   </metadata>
Aug 16 20:03:00 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:03:00 user nova-compute[72894]:     <system>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="serial">7b2c0761-d8f9-411b-8df7-9f79795029fd</entry>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="uuid">7b2c0761-d8f9-411b-8df7-9f79795029fd</entry>
Aug 16 20:03:00 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:03:00 user nova-compute[72894]:     </system>
Aug 16 20:03:00 user nova-compute[72894]:   </sysinfo>
Aug 16 20:03:00 user nova-compute[72894]:   <os>
Aug 16 20:03:00 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:03:00 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:03:00 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:03:00 user nova-compute[72894]:   </os>
Aug 16 20:03:00 user nova-compute[72894]:   <features>
Aug 16 20:03:00 user nova-compute[72894]:     <acpi/>
Aug 16 20:03:00 user nova-compute[72894]:     <apic/>
Aug 16 20:03:00 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:03:00 user nova-compute[72894]:   </features>
Aug 16 20:03:00 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:03:00 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:03:00 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:03:00 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:03:00 user nova-compute[72894]:   </clock>
Aug 16 20:03:00 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:03:00 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:03:00 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:03:00 user nova-compute[72894]:   </cpu>
Aug 16 20:03:00 user nova-compute[72894]:   <devices>
Aug 16 20:03:00 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:03:00 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:03:00 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk"/>
Aug 16 20:03:00 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:03:00 user nova-compute[72894]:     </disk>
Aug 16 20:03:00 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:03:00 user nova-compute[72894]:       <mac address="fa:16:3e:bb:a8:8b"/>
Aug 16 20:03:00 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:00 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:03:00 user nova-compute[72894]:       <target dev="tapdf7bc3c8-2a"/>
Aug 16 20:03:00 user nova-compute[72894]:     </interface>
Aug 16 20:03:00 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:03:00 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/console.log" append="off"/>
Aug 16 20:03:00 user nova-compute[72894]:     </serial>
Aug 16 20:03:00 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:03:00 user nova-compute[72894]:     <video>
Aug 16 20:03:00 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:00 user nova-compute[72894]:     </video>
Aug 16 20:03:00 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:03:00 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:03:00 user nova-compute[72894]:     </rng>
Aug 16 20:03:00 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:03:00 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:03:00 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:03:00 user nova-compute[72894]:     </memballoon>
Aug 16 20:03:00 user nova-compute[72894]:   </devices>
Aug 16 20:03:00 user nova-compute[72894]: </domain>
Aug 16 20:03:00 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1834134842',display_name='tempest-TestVolumeSwap-server-1834134842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1834134842',id=16,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnA22GQypd5ohEWUDbaltdiUGAzD/EBDX4fxSADK4RYBm+4rS/N1pEGLsFwkdzrHp2J88S3bCat2C5sjwkR9bw31XkoXMdZ22uvfTKkyi/DoLM/jQm+oqewXom1cnfHAw==',key_name='tempest-keypair-1156483859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf0814c43b248be85d1a2db26870976',ramdisk_id='',reservation_id='r-knpm6s1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1153771719',owner_user_name='tempest-TestVolumeSwap-1153771719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bebd9cb0f85b44498beafbbb256b68be',uuid=7b2c0761-d8f9-411b-8df7-9f79795029fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converting VIF {"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_vif [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf7bc3c8-2a, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf7bc3c8-2a, col_values=(('external_ids', {'iface-id': 'df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:a8:8b', 'vm-uuid': '7b2c0761-d8f9-411b-8df7-9f79795029fd'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: INFO os_vif [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a')
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] No VIF found with MAC fa:16:3e:bb:a8:8b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance destroyed successfully.
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'resources' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCIC1lih8ZhTOQnbgqKwnejhzZhSn9ZbbdBeKAtGmF4RIWc3My0AeBFwVh0XOPwawoYZSTtSlGv+CVCKF0Bys5iZoT+K3+qASd46AIDrLO7i4YD55nJ9KhayC9B08IG+A==',key_name='tempest-TestShelveInstance-37858656',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:01:42Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_vif [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c4317ba-fb, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:00 user nova-compute[72894]: INFO os_vif [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb')
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a423e2-9e37-4a64-9431-56594f356f75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a338c937-2b8b-4f20-9f58-5910dbb7c5e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990601510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'): ({'sdi'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Removing single pathed devices sdi {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab6315-aac1-4ef9-bdc4-a3aa9f758f77]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fed5aec-ff05-49f6-8648-8fbeaad4c70c]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flushing IO for device /dev/sdi {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04df001-2003-45f9-beba-83761d224c04]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f6601-19ff-4989-8f64-eb7ef37e95a2]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] SCSI volumes sdi have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Updated VIF entry in instance network info cache for port c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Updating instance_info_cache with network_info: [{"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4818cd6-b4a8-4f2f-8314-3bda0ba39e16]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c651d01-672a-4204-8768-de9ff89f497d req-c1e9e394-f305-446b-85ee-1269558e9103 service nova] Releasing lock "refresh_cache-aa07273d-a81d-4684-a12c-2f1f24fb1c9e" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-changed-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Refreshing instance network info cache due to event network-changed-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Acquiring lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Acquired lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Refreshing network info cache for port df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641f2cd-ab23-46da-bb2c-e09dc48da536]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]
Aug 16 20:03:00 user nova-compute[72894]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9930337-a5e1-4ae4-b4d6-09ecc6f88c6a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== disconnect_volume: return (337ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:03:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deleting instance files /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3_del
Aug 16 20:03:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deletion of /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3_del complete
Aug 16 20:03:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updated VIF entry in instance network info cache for port df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updating instance_info_cache with network_info: [{"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Releasing lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing instance network info cache due to event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:01 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Deleted allocations for instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'numa_topology' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated VIF entry in instance network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.network.neutron [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": null, "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26e4a370-08eb-4dce-8454-5b83228d6114 req-bb1300c5-ff1c-4bba-bff5-5ab4ec38a319 service nova] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e0209263-f62f-40c5-ade1-f0e0ee7ec4b9 tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.687s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] No waiting events found dispatching network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:02 user nova-compute[72894]: WARNING nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received unexpected event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 for instance with vm_state building and task_state spawning.
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] No waiting events found dispatching network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:02 user nova-compute[72894]: WARNING nova.compute.manager [req-efcfbb7b-4457-4d26-b804-a599b7142a88 req-7a8ce119-9016-4db6-bbd9-7b15734726e3 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received unexpected event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 for instance with vm_state building and task_state spawning.
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.utils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090acb3-4f05-4d9f-94e8-b52d32907fc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[14391995-3dd7-4f56-9dfa-5bdaf985a560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa5785-0100-4b4f-8e23-f9ee343d448f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc91e3-6407-45fe-906c-c4e9cdc4532a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:03 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:03:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5d63fb-b2cd-4e56-a503-f8d626b58837]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG os_brick.utils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Updating existing volume attachment record: 73f84cf5-3037-4587-952e-5ec79d684e3d {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:03:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216184.0936153, 7b2c0761-d8f9-411b-8df7-9f79795029fd => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] VM Resumed (Lifecycle Event)
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Instance spawned successfully.
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216184.0986307, 7b2c0761-d8f9-411b-8df7-9f79795029fd => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] VM Started (Lifecycle Event)
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Took 8.35 seconds to spawn the instance on the hypervisor.
Aug 16 20:03:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:04 user nova-compute[72894]: INFO nova.compute.manager [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Took 9.43 seconds to build instance.
Aug 16 20:03:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c4172cee-e841-4178-8dce-cc0faf3b3e02 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.531s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:12 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216177.665938, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:12 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Stopped (Lifecycle Event)
Aug 16 20:03:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7478e7d3-774b-4cae-877e-d1cada9dd82b None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-changed-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Refreshing instance network info cache due to event network-changed-95d8940b-470c-4483-844f-a4f46d7059c5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] Acquiring lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] Acquired lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Refreshing network info cache for port 95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updated VIF entry in instance network info cache for port 95d8940b-470c-4483-844f-a4f46d7059c5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:14 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating instance_info_cache with network_info: [{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3a64cde-c0e0-4972-9376-8a53027bccd7 req-92fff732-e16d-4031-9d2b-aa07247810ef service nova] Releasing lock "refresh_cache-ff3a42d6-469e-4194-be6d-eacc72cc87fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'flavor' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:15 user nova-compute[72894]: INFO nova.compute.manager [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attaching volume 0d3767e2-4d88-4be6-942e-b3e83303b82f to /dev/vdb
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.utils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa2a80-00f6-42ee-b0a1-632ddd3de764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[715969ff-44c5-4922-864b-e02288240f05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a073f-d86c-44c4-9bd5-454484530c5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[589173e4-904d-4243-83c9-160850419344]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:15 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:03:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ea4c3-b756-4f90-a720-c7062d75e747]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG os_brick.utils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:15 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating existing volume attachment record: 2afef9bb-68de-4255-a23f-57c6155a88ef {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:03:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:03:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Creating image(s)
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Ensure instance console log exists: /opt/stack/data/nova/instances/aa07273d-a81d-4684-a12c-2f1f24fb1c9e/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Start _get_guest_xml network_info=[{"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '73f84cf5-3037-4587-952e-5ec79d684e3d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTMaSlYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa07273d-a81d-4684-a12c-2f1f24fb1c9e', 'attached_at': '', 'detached_at': '', 'volume_id': '704f6ad0-4027-439f-8c5d-0aae52932ea4', 'serial': '704f6ad0-4027-439f-8c5d-0aae52932ea4'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:03:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTMaSlYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:21 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:21 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:21 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c773de-6e53-4c33-8377-a64f4ec6e62a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:03:21 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c90bc-04c2-4cc7-b4f3-e3f8b4010837]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4] added
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fa300b-92fe-4bd0-801e-60f78100c10b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[21519a5b-c4a5-4ba7-8492-2c3853495f0b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTMaSlYQ {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTMaSlYQ" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f8e8a-b194-436b-b9c6-05d2b983b32d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTMaSlYQ'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf42e8-4f85-47dc-84d5-3ee0c82d2d96]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bd897-697a-4e14-ba2a-118c9e5a75cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f639a9-45b9-47c3-933d-39cc956f063a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260]
Aug 16 20:03:21 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c1c4d-95a1-44d7-9e02-ea1f881bd5ca]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86a8b1-afb7-42d3-a3ea-5ea7cea7a0e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:21 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[16963fdb-6b68-41be-9fd4-0c4f4967638c]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:21 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTMaSlYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23537616536613262', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537616536613262', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-888930515',display_name='tempest-TestVolumeBootPattern-server-888930515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-888930515',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-vmquv5kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:57Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=aa07273d-a81d-4684-a12c-2f1f24fb1c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid aa07273d-a81d-4684-a12c-2f1f24fb1c9e {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:03:22 user nova-compute[72894]:   <uuid>aa07273d-a81d-4684-a12c-2f1f24fb1c9e</uuid>
Aug 16 20:03:22 user nova-compute[72894]:   <name>instance-00000011</name>
Aug 16 20:03:22 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:03:22 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:03:22 user nova-compute[72894]:   <metadata>
Aug 16 20:03:22 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:03:22 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:03:22 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-server-888930515</nova:name>
Aug 16 20:03:22 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:03:21</nova:creationTime>
Aug 16 20:03:22 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:03:22 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:03:22 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:03:22 user nova-compute[72894]:       <nova:owner>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:03:22 user nova-compute[72894]:       </nova:owner>
Aug 16 20:03:22 user nova-compute[72894]:       <nova:ports>
Aug 16 20:03:22 user nova-compute[72894]:         <nova:port uuid="c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0">
Aug 16 20:03:22 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:03:22 user nova-compute[72894]:         </nova:port>
Aug 16 20:03:22 user nova-compute[72894]:       </nova:ports>
Aug 16 20:03:22 user nova-compute[72894]:     </nova:instance>
Aug 16 20:03:22 user nova-compute[72894]:   </metadata>
Aug 16 20:03:22 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:03:22 user nova-compute[72894]:     <system>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="serial">aa07273d-a81d-4684-a12c-2f1f24fb1c9e</entry>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="uuid">aa07273d-a81d-4684-a12c-2f1f24fb1c9e</entry>
Aug 16 20:03:22 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:03:22 user nova-compute[72894]:     </system>
Aug 16 20:03:22 user nova-compute[72894]:   </sysinfo>
Aug 16 20:03:22 user nova-compute[72894]:   <os>
Aug 16 20:03:22 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:03:22 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:03:22 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:03:22 user nova-compute[72894]:   </os>
Aug 16 20:03:22 user nova-compute[72894]:   <features>
Aug 16 20:03:22 user nova-compute[72894]:     <acpi/>
Aug 16 20:03:22 user nova-compute[72894]:     <apic/>
Aug 16 20:03:22 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:03:22 user nova-compute[72894]:   </features>
Aug 16 20:03:22 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:03:22 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:03:22 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:03:22 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:03:22 user nova-compute[72894]:   </clock>
Aug 16 20:03:22 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:03:22 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:03:22 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:03:22 user nova-compute[72894]:   </cpu>
Aug 16 20:03:22 user nova-compute[72894]:   <devices>
Aug 16 20:03:22 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:03:22 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:03:22 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 20:03:22 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:03:22 user nova-compute[72894]:       <serial>704f6ad0-4027-439f-8c5d-0aae52932ea4</serial>
Aug 16 20:03:22 user nova-compute[72894]:     </disk>
Aug 16 20:03:22 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:03:22 user nova-compute[72894]:       <mac address="fa:16:3e:44:ea:f4"/>
Aug 16 20:03:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:22 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:03:22 user nova-compute[72894]:       <target dev="tapc8a6432c-f4"/>
Aug 16 20:03:22 user nova-compute[72894]:     </interface>
Aug 16 20:03:22 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:03:22 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/aa07273d-a81d-4684-a12c-2f1f24fb1c9e/console.log" append="off"/>
Aug 16 20:03:22 user nova-compute[72894]:     </serial>
Aug 16 20:03:22 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:03:22 user nova-compute[72894]:     <video>
Aug 16 20:03:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:22 user nova-compute[72894]:     </video>
Aug 16 20:03:22 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:03:22 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:03:22 user nova-compute[72894]:     </rng>
Aug 16 20:03:22 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:03:22 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:03:22 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:03:22 user nova-compute[72894]:     </memballoon>
Aug 16 20:03:22 user nova-compute[72894]:   </devices>
Aug 16 20:03:22 user nova-compute[72894]: </domain>
Aug 16 20:03:22 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-888930515',display_name='tempest-TestVolumeBootPattern-server-888930515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-888930515',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-vmquv5kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:02:57Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=aa07273d-a81d-4684-a12c-2f1f24fb1c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG os_vif [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8a6432c-f4, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8a6432c-f4, col_values=(('external_ids', {'iface-id': 'c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ea:f4', 'vm-uuid': 'aa07273d-a81d-4684-a12c-2f1f24fb1c9e'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:22 user nova-compute[72894]: INFO os_vif [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4')
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:44:ea:f4, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] No waiting events found dispatching network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:24 user nova-compute[72894]: WARNING nova.compute.manager [req-fe8082d8-6503-43d9-8a0a-a59bc35f6423 req-ecaec7bf-6946-4db3-af39-ce5aa102d32d service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received unexpected event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 for instance with vm_state building and task_state spawning.
Aug 16 20:03:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216206.4167664, aa07273d-a81d-4684-a12c-2f1f24fb1c9e => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] VM Resumed (Lifecycle Event)
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Instance spawned successfully.
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216206.4178517, aa07273d-a81d-4684-a12c-2f1f24fb1c9e => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] VM Started (Lifecycle Event)
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Took 5.22 seconds to spawn the instance on the hypervisor.
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:26 user nova-compute[72894]: INFO nova.compute.manager [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Took 30.85 seconds to build instance.
Aug 16 20:03:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9a8034e1-f5eb-4f74-aa69-4a1482d6abdc tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.999s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] No waiting events found dispatching network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:26 user nova-compute[72894]: WARNING nova.compute.manager [req-a72f5de9-5863-40c4-8652-62d78edb2d87 req-1894bda9-a68f-4a4a-9ece-abd9014aafb9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received unexpected event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 for instance with vm_state active and task_state None.
Aug 16 20:03:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:27 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:27 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:27 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:03:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f075eb-d8aa-4b9b-bd7a-e2d26f5a46e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:03:27 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd55df7-0016-45f2-afce-e1bf7651be1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f] added
Aug 16 20:03:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd843aa-1cd6-4dc0-9528-6b20c3628691]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d0e2d-d235-452d-b694-44ab3b0d99ce]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfsCNLrt {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfsCNLrt" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6d9a8e-f593-49c0-a04c-1ead664c0a9b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nfsCNLrt'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76e82e-75fe-404e-bdf6-d3b3c0a802ab]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca7c86-c5c1-4b46-ba65-90de539a60b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b4d32a-1de7-40b1-956f-4afce59ae575]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]
Aug 16 20:03:28 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778e6af-57ea-4182-b8bd-ff93f80c5fa9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c76c59-8024-4bc3-a8f3-9d7cbade89ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:28 user nova-compute[72894]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f6a17-4614-4d41-a440-398413d0bbde]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:03:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23630646431366430', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630646431366430', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'flavor' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:03:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:03:29 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:03:29 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:03:29 user nova-compute[72894]:   <serial>0d3767e2-4d88-4be6-942e-b3e83303b82f</serial>
Aug 16 20:03:29 user nova-compute[72894]: </disk>
Aug 16 20:03:29 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:cd:76:ff, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c97468c0-b28a-4f79-8e9a-5ce186715a74 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.615s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:03:31 user nova-compute[72894]: INFO nova.compute.claims [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Claim successful on node user
Aug 16 20:03:31 user nova-compute[72894]: INFO nova.compute.manager [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Rebuilding instance
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'trusted_certs' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_requests' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_devices' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'resources' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'migration_context' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72894) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:32 user nova-compute[72894]: WARNING nova.compute.manager [req-dcda82af-d908-465c-a564-12a6006a2999 req-7543f51d-1718-4b1f-a2f4-4b6089af8b90 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state active and task_state rebuilding.
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.policy [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be3a706becb041598d5a63714a389801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb5629d37246269932266408249714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.compute.claims [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Claim successful on node user
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Creating image(s)
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.258s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance destroyed successfully.
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk 1073741824" returned: 0 in 0.063s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.compute.manager [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Detaching volume 0d3767e2-4d88-4be6-942e-b3e83303b82f
Aug 16 20:03:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.virt.block_device [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attempting to driver detach volume 0d3767e2-4d88-4be6-942e-b3e83303b82f from mountpoint /dev/vdb
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Attempting to detach device vdb from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:03:32 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:03:32 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:03:32 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:03:32 user nova-compute[72894]:   <serial>0d3767e2-4d88-4be6-942e-b3e83303b82f</serial>
Aug 16 20:03:32 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:03:32 user nova-compute[72894]: </disk>
Aug 16 20:03:32 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully detached device vdb from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the persistent domain config.
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:03:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:33 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.835s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Successfully created port: 05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f180016c-39d2-4c0c-91e4-58f434979edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cc9f4-41dc-4cec-88d4-466b180b2343]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:33 user nova-compute[72894]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799055fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12144175-2e29-4386-aaae-ed7ba87b7607]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a59a7-7d96-4587-97b8-12a7f1d6c7ea]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a38165-78e5-4f1b-a92c-6638b85f56b5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Cannot resize image /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Ensure instance console log exists: /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34f0df-0f78-421d-afcf-8ff250436b2e]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.policy [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be3a706becb041598d5a63714a389801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb5629d37246269932266408249714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3835a22-1bc9-42c5-8d6a-519b80907c24]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:03:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Creating image(s)
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e857dca6-cc57-4469-96e2-9f5d1798b90f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]
Aug 16 20:03:33 user nova-compute[72894]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8709059-778e-4f2d-8fb6-62d10f5bac1f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== disconnect_volume: return (326ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk 1073741824" returned: 0 in 0.052s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Successfully created port: 1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.218s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:03:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Cannot resize image /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Ensure instance console log exists: /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:34 user nova-compute[72894]: WARNING nova.compute.manager [req-26eebb79-8e6d-449c-8281-b39609a2d195 req-7010ee01-3d40-49a1-81cc-0981c72fe8a6 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state active and task_state rebuilding.
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:03:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance destroyed successfully.
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-ServerActionsTestOtherA-server-1906060169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95d8940b-47, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:34 user nova-compute[72894]: INFO os_vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47')
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:34 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e1bc38-2733-4f8f-879a-2e31fb1aaa63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a05e1-82d7-4287-a82e-ee060134580a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c6972e0>, {}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Disconnecting from: [] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== disconnect_volume: return (58ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:03:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Deleting instance files /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd_del
Aug 16 20:03:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Deletion of /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd_del complete
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Successfully updated port: 05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-changed-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Refreshing instance network info cache due to event network-changed-05779040-3363-4917-a20c-c2971d311404. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:34 user nova-compute[72894]: INFO nova.virt.block_device [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Booting with volume 0d3767e2-4d88-4be6-942e-b3e83303b82f at /dev/vdb
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Successfully updated port: 1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a66f69-efce-4695-b7cb-6aa1ffca8623]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e7198-09ac-4b31-a342-cf4a0fd229b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d689a-7cf2-49e8-a693-bdead089c5d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b850c2-12f6-4c00-be76-56dca66a40b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:34 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2642e157-a1e9-4426-acac-c9913cdbbd94]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG os_brick.utils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating existing volume attachment record: c2289448-c14f-421d-942d-6f4e86639172 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:03:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance network_info: |[{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Refreshing network info cache for port 05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start _get_guest_xml network_info=[{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:03:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1176160800',display_name='tempest-ServerRescueNegativeTestJSON-server-1176160800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1176160800',id=18,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-1jnbdiq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:32Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=60dd6c6f-825a-4367-a215-c3989d1db134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:03:35 user nova-compute[72894]:   <uuid>60dd6c6f-825a-4367-a215-c3989d1db134</uuid>
Aug 16 20:03:35 user nova-compute[72894]:   <name>instance-00000012</name>
Aug 16 20:03:35 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:03:35 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:03:35 user nova-compute[72894]:   <metadata>
Aug 16 20:03:35 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:03:35 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1176160800</nova:name>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:03:35</nova:creationTime>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:03:35 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:owner>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:owner>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:ports>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:port uuid="05779040-3363-4917-a20c-c2971d311404">
Aug 16 20:03:35 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 20:03:35 user nova-compute[72894]:         </nova:port>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:ports>
Aug 16 20:03:35 user nova-compute[72894]:     </nova:instance>
Aug 16 20:03:35 user nova-compute[72894]:   </metadata>
Aug 16 20:03:35 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:03:35 user nova-compute[72894]:     <system>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="serial">60dd6c6f-825a-4367-a215-c3989d1db134</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="uuid">60dd6c6f-825a-4367-a215-c3989d1db134</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:03:35 user nova-compute[72894]:     </system>
Aug 16 20:03:35 user nova-compute[72894]:   </sysinfo>
Aug 16 20:03:35 user nova-compute[72894]:   <os>
Aug 16 20:03:35 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:03:35 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:03:35 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:03:35 user nova-compute[72894]:   </os>
Aug 16 20:03:35 user nova-compute[72894]:   <features>
Aug 16 20:03:35 user nova-compute[72894]:     <acpi/>
Aug 16 20:03:35 user nova-compute[72894]:     <apic/>
Aug 16 20:03:35 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:03:35 user nova-compute[72894]:   </features>
Aug 16 20:03:35 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:03:35 user nova-compute[72894]:   </clock>
Aug 16 20:03:35 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:03:35 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:03:35 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:03:35 user nova-compute[72894]:   </cpu>
Aug 16 20:03:35 user nova-compute[72894]:   <devices>
Aug 16 20:03:35 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:03:35 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:03:35 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk"/>
Aug 16 20:03:35 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:     </disk>
Aug 16 20:03:35 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:03:35 user nova-compute[72894]:       <mac address="fa:16:3e:65:ca:1e"/>
Aug 16 20:03:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:03:35 user nova-compute[72894]:       <target dev="tap05779040-33"/>
Aug 16 20:03:35 user nova-compute[72894]:     </interface>
Aug 16 20:03:35 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:03:35 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/console.log" append="off"/>
Aug 16 20:03:35 user nova-compute[72894]:     </serial>
Aug 16 20:03:35 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:03:35 user nova-compute[72894]:     <video>
Aug 16 20:03:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:     </video>
Aug 16 20:03:35 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:03:35 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:03:35 user nova-compute[72894]:     </rng>
Aug 16 20:03:35 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:03:35 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:03:35 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:03:35 user nova-compute[72894]:     </memballoon>
Aug 16 20:03:35 user nova-compute[72894]:   </devices>
Aug 16 20:03:35 user nova-compute[72894]: </domain>
Aug 16 20:03:35 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1176160800',display_name='tempest-ServerRescueNegativeTestJSON-server-1176160800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1176160800',id=18,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-1jnbdiq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:32Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=60dd6c6f-825a-4367-a215-c3989d1db134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG os_vif [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05779040-33, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05779040-33, col_values=(('external_ids', {'iface-id': '05779040-3363-4917-a20c-c2971d311404', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:ca:1e', 'vm-uuid': '60dd6c6f-825a-4367-a215-c3989d1db134'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: INFO os_vif [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33')
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:65:ca:1e, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance network_info: |[{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start _get_guest_xml network_info=[{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:03:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1226330475',display_name='tempest-ServerRescueNegativeTestJSON-server-1226330475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1226330475',id=19,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-pzm3fhnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:33Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=af992d03-c0d8-4ebf-92d9-cb51f74a7fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:03:35 user nova-compute[72894]:   <uuid>af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</uuid>
Aug 16 20:03:35 user nova-compute[72894]:   <name>instance-00000013</name>
Aug 16 20:03:35 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:03:35 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:03:35 user nova-compute[72894]:   <metadata>
Aug 16 20:03:35 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:03:35 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1226330475</nova:name>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:03:35</nova:creationTime>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:03:35 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:owner>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:owner>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:03:35 user nova-compute[72894]:       <nova:ports>
Aug 16 20:03:35 user nova-compute[72894]:         <nova:port uuid="1d63be3e-9879-4357-bcb6-23772caadd62">
Aug 16 20:03:35 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:03:35 user nova-compute[72894]:         </nova:port>
Aug 16 20:03:35 user nova-compute[72894]:       </nova:ports>
Aug 16 20:03:35 user nova-compute[72894]:     </nova:instance>
Aug 16 20:03:35 user nova-compute[72894]:   </metadata>
Aug 16 20:03:35 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:03:35 user nova-compute[72894]:     <system>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="serial">af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="uuid">af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</entry>
Aug 16 20:03:35 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:03:35 user nova-compute[72894]:     </system>
Aug 16 20:03:35 user nova-compute[72894]:   </sysinfo>
Aug 16 20:03:35 user nova-compute[72894]:   <os>
Aug 16 20:03:35 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:03:35 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:03:35 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:03:35 user nova-compute[72894]:   </os>
Aug 16 20:03:35 user nova-compute[72894]:   <features>
Aug 16 20:03:35 user nova-compute[72894]:     <acpi/>
Aug 16 20:03:35 user nova-compute[72894]:     <apic/>
Aug 16 20:03:35 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:03:35 user nova-compute[72894]:   </features>
Aug 16 20:03:35 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:03:35 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:03:35 user nova-compute[72894]:   </clock>
Aug 16 20:03:35 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:03:35 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:03:35 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:03:35 user nova-compute[72894]:   </cpu>
Aug 16 20:03:35 user nova-compute[72894]:   <devices>
Aug 16 20:03:35 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:03:35 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:03:35 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk"/>
Aug 16 20:03:35 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:     </disk>
Aug 16 20:03:35 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:03:35 user nova-compute[72894]:       <mac address="fa:16:3e:4d:8f:e9"/>
Aug 16 20:03:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:03:35 user nova-compute[72894]:       <target dev="tap1d63be3e-98"/>
Aug 16 20:03:35 user nova-compute[72894]:     </interface>
Aug 16 20:03:35 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:03:35 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/console.log" append="off"/>
Aug 16 20:03:35 user nova-compute[72894]:     </serial>
Aug 16 20:03:35 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:03:35 user nova-compute[72894]:     <video>
Aug 16 20:03:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:35 user nova-compute[72894]:     </video>
Aug 16 20:03:35 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:03:35 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:03:35 user nova-compute[72894]:     </rng>
Aug 16 20:03:35 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:03:35 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:03:35 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:03:35 user nova-compute[72894]:     </memballoon>
Aug 16 20:03:35 user nova-compute[72894]:   </devices>
Aug 16 20:03:35 user nova-compute[72894]: </domain>
Aug 16 20:03:35 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1226330475',display_name='tempest-ServerRescueNegativeTestJSON-server-1226330475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1226330475',id=19,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-pzm3fhnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:33Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=af992d03-c0d8-4ebf-92d9-cb51f74a7fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG os_vif [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d63be3e-98, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d63be3e-98, col_values=(('external_ids', {'iface-id': '1d63be3e-9879-4357-bcb6-23772caadd62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:8f:e9', 'vm-uuid': 'af992d03-c0d8-4ebf-92d9-cb51f74a7fd2'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:35 user nova-compute[72894]: INFO os_vif [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98')
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updated VIF entry in instance network info cache for port 05779040-3363-4917-a20c-c2971d311404. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:4d:8f:e9, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'ff3a42d6-469e-4194-be6d-eacc72cc87fd' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ff3a42d6-469e-4194-be6d-eacc72cc87fd' (instance-0000000c)
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c3ee6051-fd06-4972-8969-60a287d8439f req-87063a9b-be1f-4340-b68c-bebbe991613a service nova] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-changed-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Refreshing instance network info cache due to event network-changed-1d63be3e-9879-4357-bcb6-23772caadd62. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] Acquiring lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] Acquired lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG nova.network.neutron [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Refreshing network info cache for port 1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG nova.network.neutron [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updated VIF entry in instance network info cache for port 1d63be3e-9879-4357-bcb6-23772caadd62. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG nova.network.neutron [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f1c548e-0e2c-4361-8baa-93da52af4c89 req-0453940c-9348-4fad-90ad-65535710138d service nova] Releasing lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216221.1317, af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:41 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] VM Resumed (Lifecycle Event)
Aug 16 20:03:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.compute.manager [req-fbc7da3b-e3bd-437b-8690-78f88b20217d req-c793bbf2-85d0-445c-a6a5-5c7c305b209a service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state building and task_state spawning.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.compute.manager [req-71f55df2-260d-4f88-84da-e2a6e788db3d req-c5431987-8ba4-42da-939c-357e19827923 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state building and task_state spawning.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.compute.manager [req-3d356f55-53c0-45d9-af81-2551b2fe13da req-bc4f34cd-c73f-44d0-9493-dded6526c40e service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state building and task_state spawning.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.compute.manager [req-caaf0fc2-809f-40d7-99d3-28515fe3e2cf req-9f520690-0f53-41a1-9641-a2fd67ed83d5 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state building and task_state spawning.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance spawned successfully.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7207MB free_disk=24.476837158203125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance spawned successfully.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:03:41 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216221.1337616, af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:41 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] VM Started (Lifecycle Event)
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216221.1758325, 60dd6c6f-825a-4367-a215-c3989d1db134 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Resumed (Lifecycle Event)
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Took 9.78 seconds to spawn the instance on the hypervisor.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216221.1759675, 60dd6c6f-825a-4367-a215-c3989d1db134 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Started (Lifecycle Event)
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Applying migration context for instance 12dd204d-9368-47c2-88e2-8d97ff942621 as it has an incoming, in-progress migration ff1d0b0a-f652-492b-aca0-618c134935e3. Migration status is finished {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating resource usage from migration ff1d0b0a-f652-492b-aca0-618c134935e3
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Took 9.94 seconds to build instance.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f66862fa-70f7-40c2-aca5-54e41876a9a6 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.075s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Migration ff1d0b0a-f652-492b-aca0-618c134935e3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 280e6782-15c7-4a5d-8026-716edb653428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 2073e7a0-b213-44da-9249-47ace2f78b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7b2c0761-d8f9-411b-8df7-9f79795029fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance aa07273d-a81d-4684-a12c-2f1f24fb1c9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:03:42 user nova-compute[72894]: INFO nova.compute.manager [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Took 10.83 seconds to build instance.
Aug 16 20:03:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5052ad62-8959-475f-b48d-eea80dcdc1c5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.953s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.841s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:03:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Port 2ea3d08c-315a-4008-917c-b629398a8b98 binding to destination host user is already ACTIVE {{(pid=72894) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 20:03:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Creating tmpfile /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/tmph_l2mrbh to verify with other compute node that the instance is on the same shared storage. {{(pid=72894) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:44 user nova-compute[72894]: WARNING nova.compute.manager [req-ab9731bd-8398-4edf-8da6-f2b99f4efd8b req-05985a0f-42e4-4b62-8e4d-0e31d1dffca9 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state resized and task_state resize_reverting.
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance destroyed successfully.
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'resources' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea3d08c-31, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:45 user nova-compute[72894]: INFO os_vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a3e8c7-69dd-4c61-b38c-3fc3f92f003e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d3fae-e6c5-4fbc-8a86-8f6f93c7bc42]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990455360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[95820c4a-f4db-4db6-b2e6-ca9c16045747]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[25307c23-c0bc-4006-b7ab-ae52720b3311]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c9972-d844-42ba-a812-59060ebf9017]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a75f49c-8467-456c-8a4a-2d1007c11620]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9150d0e-c0bb-4732-80a7-2bf0a723426c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[095916d5-8170-48bb-88c2-cc46789acd3e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:03:45 user nova-compute[72894]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d8ff79-81d3-497f-874c-f0f20d72a1d6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== disconnect_volume: return (323ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'migration_context' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:46 user nova-compute[72894]: WARNING nova.compute.manager [req-66a122b4-d8b4-4341-8a6e-aca16d8cd961 req-50871d72-ba77-44fc-8c87-2e57a452232c service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state resized and task_state resize_reverting.
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.641s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216212.657403, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:47 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Stopped (Lifecycle Event)
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4d0800a4-d78a-475c-ac39-b3bbaa01bf66 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:47 user nova-compute[72894]: INFO nova.compute.manager [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Swapping old allocation on dict_keys(['3aeddb5a-5151-4ab0-bd05-66d638b30977']) held by migration ff1d0b0a-f652-492b-aca0-618c134935e3 for instance
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Overwriting current allocation {'allocations': {'3aeddb5a-5151-4ab0-bd05-66d638b30977': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '71a2a663816647aa9bb26ac44848f40e', 'user_id': 'a82f6efbf71343eca3f5b09517d3a86d', 'consumer_generation': 1} on consumer 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquired lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:03:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:03:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Creating image(s)
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Releasing lock "refresh_cache-12dd204d-9368-47c2-88e2-8d97ff942621" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.utils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f288d6b-0998-4822-8d5c-f8c3c0752238]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd659a3e-ea79-4d28-afab-2df4f9d675bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478d5eb-fce8-4aed-9626-ee2089415414]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e5e6a5-9b1a-484f-bab5-a1746631d5a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.229s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:03:48 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[42602b89-b1ae-4b8c-acbf-4d33d388d984]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG os_brick.utils [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk 1073741824" returned: 0 in 0.056s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:03:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Cannot resize image /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Ensure instance console log exists: /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start _get_guest_xml network_info=[{"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'c2289448-c14f-421d-942d-6f4e86639172', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff3a42d6-469e-4194-be6d-eacc72cc87fd', 'attached_at': '', 'detached_at': '', 'volume_id': '0d3767e2-4d88-4be6-942e-b3e83303b82f', 'serial': '0d3767e2-4d88-4be6-942e-b3e83303b82f'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:03:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 20:03:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:03:49 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:49 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:03:49 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3e990-46c9-461b-9260-668f1c244103]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:03:49 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9948c271-4c10-47ed-b4b6-a10ddfa22bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f] added
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[10321896-7341-460b-901e-80663f6ec08a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d772fc4-6f28-4e5b-9ebc-10f098cb595b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfsCNLrt {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfsCNLrt" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a816151-97b5-40fa-a7a3-5c196f988c60]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nfsCNLrt'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd32dad-6a01-495f-84ce-bbe592b49f46]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc51d05-d872-4af5-a93e-2b85dd82d543]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06969dd7-6b5b-49e3-9956-4545763d1bf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]
Aug 16 20:03:49 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64983c-96db-45f9-b1aa-41c88f4c7ac2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1cfffd-1c1b-4fb4-b747-b9dab02cd75e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:03:49 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:03:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b4ec2-7657-4904-929a-5733f1d4f4d7]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:03:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23630646431366430', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630646431366430', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-ServerActionsTestOtherA-server-1906060169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:03:50 user nova-compute[72894]:   <uuid>ff3a42d6-469e-4194-be6d-eacc72cc87fd</uuid>
Aug 16 20:03:50 user nova-compute[72894]:   <name>instance-0000000c</name>
Aug 16 20:03:50 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:03:50 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:03:50 user nova-compute[72894]:   <metadata>
Aug 16 20:03:50 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:03:50 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherA-server-1906060169</nova:name>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:03:49</nova:creationTime>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:03:50 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:03:50 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:owner>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:user uuid="6787ebe74f6445caa43d44813f58ab21">tempest-ServerActionsTestOtherA-2019589976-project-member</nova:user>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:project uuid="0d388dc7ba4643d198d2999ec1f87afe">tempest-ServerActionsTestOtherA-2019589976</nova:project>
Aug 16 20:03:50 user nova-compute[72894]:       </nova:owner>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:03:50 user nova-compute[72894]:       <nova:ports>
Aug 16 20:03:50 user nova-compute[72894]:         <nova:port uuid="95d8940b-470c-4483-844f-a4f46d7059c5">
Aug 16 20:03:50 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:03:50 user nova-compute[72894]:         </nova:port>
Aug 16 20:03:50 user nova-compute[72894]:       </nova:ports>
Aug 16 20:03:50 user nova-compute[72894]:     </nova:instance>
Aug 16 20:03:50 user nova-compute[72894]:   </metadata>
Aug 16 20:03:50 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:03:50 user nova-compute[72894]:     <system>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="serial">ff3a42d6-469e-4194-be6d-eacc72cc87fd</entry>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="uuid">ff3a42d6-469e-4194-be6d-eacc72cc87fd</entry>
Aug 16 20:03:50 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:03:50 user nova-compute[72894]:     </system>
Aug 16 20:03:50 user nova-compute[72894]:   </sysinfo>
Aug 16 20:03:50 user nova-compute[72894]:   <os>
Aug 16 20:03:50 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:03:50 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:03:50 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:03:50 user nova-compute[72894]:   </os>
Aug 16 20:03:50 user nova-compute[72894]:   <features>
Aug 16 20:03:50 user nova-compute[72894]:     <acpi/>
Aug 16 20:03:50 user nova-compute[72894]:     <apic/>
Aug 16 20:03:50 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:03:50 user nova-compute[72894]:   </features>
Aug 16 20:03:50 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:03:50 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:03:50 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:03:50 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:03:50 user nova-compute[72894]:   </clock>
Aug 16 20:03:50 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:03:50 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:03:50 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:03:50 user nova-compute[72894]:   </cpu>
Aug 16 20:03:50 user nova-compute[72894]:   <devices>
Aug 16 20:03:50 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:03:50 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:03:50 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk"/>
Aug 16 20:03:50 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:03:50 user nova-compute[72894]:     </disk>
Aug 16 20:03:50 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:03:50 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:03:50 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:03:50 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:03:50 user nova-compute[72894]:       <serial>0d3767e2-4d88-4be6-942e-b3e83303b82f</serial>
Aug 16 20:03:50 user nova-compute[72894]:     </disk>
Aug 16 20:03:50 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:03:50 user nova-compute[72894]:       <mac address="fa:16:3e:cd:76:ff"/>
Aug 16 20:03:50 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:50 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:03:50 user nova-compute[72894]:       <target dev="tap95d8940b-47"/>
Aug 16 20:03:50 user nova-compute[72894]:     </interface>
Aug 16 20:03:50 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:03:50 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/console.log" append="off"/>
Aug 16 20:03:50 user nova-compute[72894]:     </serial>
Aug 16 20:03:50 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:03:50 user nova-compute[72894]:     <video>
Aug 16 20:03:50 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:03:50 user nova-compute[72894]:     </video>
Aug 16 20:03:50 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:03:50 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:03:50 user nova-compute[72894]:     </rng>
Aug 16 20:03:50 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:03:50 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:03:50 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:03:50 user nova-compute[72894]:     </memballoon>
Aug 16 20:03:50 user nova-compute[72894]:   </devices>
Aug 16 20:03:50 user nova-compute[72894]: </domain>
Aug 16 20:03:50 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-ServerActionsTestOtherA-server-1906060169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG os_vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95d8940b-47, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95d8940b-47, col_values=(('external_ids', {'iface-id': '95d8940b-470c-4483-844f-a4f46d7059c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:76:ff', 'vm-uuid': 'ff3a42d6-469e-4194-be6d-eacc72cc87fd'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:50 user nova-compute[72894]: INFO os_vif [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47')
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:03:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:cd:76:ff, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:03:53 user nova-compute[72894]: WARNING nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid f3d00d19-bfc7-4b98-b468-7d06526e6124 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 280e6782-15c7-4a5d-8026-716edb653428 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid aa07273d-a81d-4684-a12c-2f1f24fb1c9e {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: INFO nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "280e6782-15c7-4a5d-8026-716edb653428" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:53 user nova-compute[72894]: INFO nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.168s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "280e6782-15c7-4a5d-8026-716edb653428" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:54 user nova-compute[72894]: WARNING nova.compute.manager [req-20b684d3-48b5-40d7-9d09-455b5f085ab5 req-1b80a087-d294-4586-985c-a86b5f86baf3 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216234.4871316, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Resumed (Lifecycle Event)
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:03:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance spawned successfully.
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:03:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216234.4925277, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:03:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Started (Lifecycle Event)
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:03:54 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72894) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 20:03:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f421e0-1f68-4302-afa5-124543e61d64 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:56 user nova-compute[72894]: WARNING nova.compute.manager [req-17186e75-2a20-48b0-9392-2614f9bb9c7c req-af71457f-b56f-46a0-96c0-5c69ff6b09c2 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state active and task_state None.
Aug 16 20:03:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:57 user nova-compute[72894]: INFO nova.compute.manager [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Terminating instance
Aug 16 20:03:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-unplugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-unplugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-unplugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:03:58 user nova-compute[72894]: WARNING nova.compute.manager [req-3f95a6b0-b13c-40a0-94ad-308a30a9d75e req-209d169c-100d-4759-99d6-c1efedb9d999 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state active and task_state deleting.
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Instance destroyed successfully.
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lazy-loading 'resources' on Instance uuid 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1390843546',display_name='tempest-VolumesActionsTest-instance-1390843546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1390843546',id=13,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30c130e51534270bd374f0315030ffb',ramdisk_id='',reservation_id='r-xvxzsmux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1741933721',owner_user_name='tempest-VolumesActionsTest-1741933721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:02:01Z,user_data=None,user_id='4ff8197009d34be7b1aa1ed95f5cf172',uuid=35f08fa1-d2f2-4f51-b588-fbb30f1d5d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converting VIF {"id": "df6bdd29-6be0-4762-b806-03363d4d20ea", "address": "fa:16:3e:15:71:35", "network": {"id": "cbf0eb62-88f7-4ee1-a129-27b68094bae5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-138167044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30c130e51534270bd374f0315030ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6bdd29-6b", "ovs_interfaceid": "df6bdd29-6be0-4762-b806-03363d4d20ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG os_vif [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf6bdd29-6b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: INFO os_vif [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:35,bridge_name='br-int',has_traffic_filtering=True,id=df6bdd29-6be0-4762-b806-03363d4d20ea,network=Network(cbf0eb62-88f7-4ee1-a129-27b68094bae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6bdd29-6b')
Aug 16 20:03:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Deleting instance files /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54_del
Aug 16 20:03:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Deletion of /opt/stack/data/nova/instances/35f08fa1-d2f2-4f51-b588-fbb30f1d5d54_del complete
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: INFO nova.compute.manager [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 20:03:58 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:59 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Took 0.71 seconds to deallocate network for instance.
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d1f4c11-4a1c-47c6-b464-a55ea156ac15 req-ad022dce-7e3f-4df5-869d-00432dabcd6c service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-deleted-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:03:59 user nova-compute[72894]: INFO nova.compute.manager [req-8d1f4c11-4a1c-47c6-b464-a55ea156ac15 req-ad022dce-7e3f-4df5-869d-00432dabcd6c service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Neutron deleted interface df6bdd29-6be0-4762-b806-03363d4d20ea; detaching it from the instance and deleting it from the info cache
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-8d1f4c11-4a1c-47c6-b464-a55ea156ac15 req-ad022dce-7e3f-4df5-869d-00432dabcd6c service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d1f4c11-4a1c-47c6-b464-a55ea156ac15 req-ad022dce-7e3f-4df5-869d-00432dabcd6c service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Detach interface failed, port_id=df6bdd29-6be0-4762-b806-03363d4d20ea, reason: Instance 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:03:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:03:59 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Deleted allocations for instance 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54
Aug 16 20:03:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc28ead-28d4-45d4-b2a4-2977b621ec41 tempest-VolumesActionsTest-1741933721 tempest-VolumesActionsTest-1741933721-project-member] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216225.2099848, 12dd204d-9368-47c2-88e2-8d97ff942621 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:00 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Stopped (Lifecycle Event)
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:00 user nova-compute[72894]: WARNING nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state deleted and task_state None.
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:00 user nova-compute[72894]: WARNING nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state deleted and task_state None.
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Acquiring lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] Lock "35f08fa1-d2f2-4f51-b588-fbb30f1d5d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] No waiting events found dispatching network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:00 user nova-compute[72894]: WARNING nova.compute.manager [req-077bf288-81f0-4101-8636-323a91efc88d req-c3984697-b19c-4a3e-9ea1-a4e3154ecdc4 service nova] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Received unexpected event network-vif-plugged-df6bdd29-6be0-4762-b806-03363d4d20ea for instance with vm_state deleted and task_state None.
Aug 16 20:04:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f471eb1a-6491-4045-b212-cfe16a2a830c None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Starting finish_revert_migration {{(pid=72894) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start _get_guest_xml network_info=[{"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '5f1e7ca9-70a1-42b2-bfd3-31d2a9478721', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '12dd204d-9368-47c2-88e2-8d97ff942621', 'attached_at': '2023-08-16T20:04:01.000000', 'detached_at': '', 'volume_id': '91f3c5f5-09ab-464c-9d18-53e44b97f616', 'serial': '91f3c5f5-09ab-464c-9d18-53e44b97f616'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:04:01 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:01 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:04:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:04:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:04:01 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5784b365-4939-4eee-a840-f563caa21b2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:04:01 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5136b689-dc3f-4fd5-b338-7f975c5193eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616] added
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc4202-f6ab-4d7b-a3e7-1452b5d18662]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ab2cc-d2bf-41bd-a117-830aae7e1130]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTxWSRoZ" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029e352-849c-41b6-ad24-5dd3ebe10e71]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTxWSRoZ'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34a297-15da-4327-9646-0904d224f4a3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e2f7e4-42dd-4b60-858b-92b667547851]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e6c5b-1b29-458c-ae0b-1a4e2c152398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:04:01 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb9e1ec-4735-40c9-a46b-d8cede27e889]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f099a6-19df-4c1d-919e-0043b21d8689]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:01 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:04:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcaf92a-ac93-4d4f-b0cf-3d3abda4fd9e]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031616533393730', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:04:02 user nova-compute[72894]:   <uuid>12dd204d-9368-47c2-88e2-8d97ff942621</uuid>
Aug 16 20:04:02 user nova-compute[72894]:   <name>instance-00000002</name>
Aug 16 20:04:02 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:04:02 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:04:02 user nova-compute[72894]:   <metadata>
Aug 16 20:04:02 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:04:02 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherB-server-1557906681</nova:name>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:04:01</nova:creationTime>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:04:02 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:04:02 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:owner>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:user uuid="a82f6efbf71343eca3f5b09517d3a86d">tempest-ServerActionsTestOtherB-85778765-project-member</nova:user>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:project uuid="71a2a663816647aa9bb26ac44848f40e">tempest-ServerActionsTestOtherB-85778765</nova:project>
Aug 16 20:04:02 user nova-compute[72894]:       </nova:owner>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:04:02 user nova-compute[72894]:       <nova:ports>
Aug 16 20:04:02 user nova-compute[72894]:         <nova:port uuid="2ea3d08c-315a-4008-917c-b629398a8b98">
Aug 16 20:04:02 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:04:02 user nova-compute[72894]:         </nova:port>
Aug 16 20:04:02 user nova-compute[72894]:       </nova:ports>
Aug 16 20:04:02 user nova-compute[72894]:     </nova:instance>
Aug 16 20:04:02 user nova-compute[72894]:   </metadata>
Aug 16 20:04:02 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:04:02 user nova-compute[72894]:     <system>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="serial">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="uuid">12dd204d-9368-47c2-88e2-8d97ff942621</entry>
Aug 16 20:04:02 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:04:02 user nova-compute[72894]:     </system>
Aug 16 20:04:02 user nova-compute[72894]:   </sysinfo>
Aug 16 20:04:02 user nova-compute[72894]:   <os>
Aug 16 20:04:02 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:04:02 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:04:02 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:04:02 user nova-compute[72894]:   </os>
Aug 16 20:04:02 user nova-compute[72894]:   <features>
Aug 16 20:04:02 user nova-compute[72894]:     <acpi/>
Aug 16 20:04:02 user nova-compute[72894]:     <apic/>
Aug 16 20:04:02 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:04:02 user nova-compute[72894]:   </features>
Aug 16 20:04:02 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:04:02 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:04:02 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:04:02 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:04:02 user nova-compute[72894]:   </clock>
Aug 16 20:04:02 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:04:02 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:04:02 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:04:02 user nova-compute[72894]:   </cpu>
Aug 16 20:04:02 user nova-compute[72894]:   <devices>
Aug 16 20:04:02 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:04:02 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:04:02 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk"/>
Aug 16 20:04:02 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:04:02 user nova-compute[72894]:     </disk>
Aug 16 20:04:02 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:04:02 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:04:02 user nova-compute[72894]:       <source dev="/dev/sdd"/>
Aug 16 20:04:02 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:04:02 user nova-compute[72894]:       <serial>91f3c5f5-09ab-464c-9d18-53e44b97f616</serial>
Aug 16 20:04:02 user nova-compute[72894]:     </disk>
Aug 16 20:04:02 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:04:02 user nova-compute[72894]:       <mac address="fa:16:3e:30:37:0b"/>
Aug 16 20:04:02 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:04:02 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:04:02 user nova-compute[72894]:       <target dev="tap2ea3d08c-31"/>
Aug 16 20:04:02 user nova-compute[72894]:     </interface>
Aug 16 20:04:02 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:04:02 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/console.log" append="off"/>
Aug 16 20:04:02 user nova-compute[72894]:     </serial>
Aug 16 20:04:02 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:04:02 user nova-compute[72894]:     <video>
Aug 16 20:04:02 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:04:02 user nova-compute[72894]:     </video>
Aug 16 20:04:02 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:04:02 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:04:02 user nova-compute[72894]:     </rng>
Aug 16 20:04:02 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:04:02 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:04:02 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:04:02 user nova-compute[72894]:     </memballoon>
Aug 16 20:04:02 user nova-compute[72894]:   </devices>
Aug 16 20:04:02 user nova-compute[72894]: </domain>
Aug 16 20:04:02 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG os_vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea3d08c-31, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ea3d08c-31, col_values=(('external_ids', {'iface-id': '2ea3d08c-315a-4008-917c-b629398a8b98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:37:0b', 'vm-uuid': '12dd204d-9368-47c2-88e2-8d97ff942621'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:02 user nova-compute[72894]: INFO os_vif [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 20:04:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG nova.compute.manager [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG nova.compute.manager [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:04 user nova-compute[72894]: WARNING nova.compute.manager [req-b2d59fab-f474-4f0b-b829-eeed9ac06ee4 req-2bacc557-811c-4a21-ba97-2c39d19ebf8d service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state resized and task_state resize_reverting.
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:05 user nova-compute[72894]: INFO nova.compute.manager [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Terminating instance
Aug 16 20:04:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Instance destroyed successfully.
Aug 16 20:04:05 user nova-compute[72894]: DEBUG nova.objects.instance [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lazy-loading 'resources' on Instance uuid 280e6782-15c7-4a5d-8026-716edb653428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1765606280',display_name='tempest-VolumesActionsTest-instance-1765606280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1765606280',id=14,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcd50fd8a7134bb2882624b5a221cfa1',ramdisk_id='',reservation_id='r-ry1vjm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-448586114',owner_user_name='tempest-VolumesActionsTest-448586114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:02:27Z,user_data=None,user_id='e6a1f78a8b054f0b84c5bcbc1fa8c286',uuid=280e6782-15c7-4a5d-8026-716edb653428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converting VIF {"id": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "address": "fa:16:3e:59:b0:c5", "network": {"id": "23e6216e-38fb-4f5b-900d-0ef833b13171", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1065440631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcd50fd8a7134bb2882624b5a221cfa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e2d785-eb", "ovs_interfaceid": "82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG os_vif [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82e2d785-eb, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:04:05 user nova-compute[72894]: INFO os_vif [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc,network=Network(23e6216e-38fb-4f5b-900d-0ef833b13171),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e2d785-eb')
Aug 16 20:04:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Deleting instance files /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428_del
Aug 16 20:04:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Deletion of /opt/stack/data/nova/instances/280e6782-15c7-4a5d-8026-716edb653428_del complete
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216246.641316, 12dd204d-9368-47c2-88e2-8d97ff942621 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Resumed (Lifecycle Event)
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance running successfully.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] finish_revert_migration finished successfully. {{(pid=72894) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216246.643037, 12dd204d-9368-47c2-88e2-8d97ff942621 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Started (Lifecycle Event)
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Took 0.79 seconds to deallocate network for instance.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:06 user nova-compute[72894]: WARNING nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state resized and task_state resize_reverting.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-unplugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] No waiting events found dispatching network-vif-unplugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-unplugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Acquiring lock "280e6782-15c7-4a5d-8026-716edb653428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] Lock "280e6782-15c7-4a5d-8026-716edb653428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] No waiting events found dispatching network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:06 user nova-compute[72894]: WARNING nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received unexpected event network-vif-plugged-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc for instance with vm_state active and task_state deleting.
Aug 16 20:04:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43a307a-0d85-4365-b349-27b0a4d04551 req-91ee78ed-e0b6-46ea-ba14-233809e8aef7 service nova] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Received event network-vif-deleted-82e2d785-ebdc-4538-b7fd-5ad7ebea2fdc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:06 user nova-compute[72894]: INFO nova.compute.manager [None req-9994a2bc-206a-40c5-addb-069166a8acc7 tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance to original state: 'active'
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.711s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.396s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:04:07 user nova-compute[72894]: INFO nova.compute.claims [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Claim successful on node user
Aug 16 20:04:07 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Deleted allocations for instance 280e6782-15c7-4a5d-8026-716edb653428
Aug 16 20:04:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25031128-50c7-4123-959e-37eec8429aee tempest-VolumesActionsTest-448586114 tempest-VolumesActionsTest-448586114-project-member] Lock "280e6782-15c7-4a5d-8026-716edb653428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.625s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:04:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.policy [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c230d020ad34a1588a93fd4a010750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b407241100354a8a97202de4aae0e75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:04:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Creating image(s)
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "/opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "/opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk 1073741824" returned: 0 in 0.047s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Successfully created port: 20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Successfully updated port: 20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquired lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-changed-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Refreshing instance network info cache due to event network-changed-20b34f9e-63d4-4f5d-b351-0250ca442c21. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] Acquiring lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updating instance_info_cache with network_info: [{"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Releasing lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Instance network_info: |[{"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] Acquired lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Refreshing network info cache for port 20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Start _get_guest_xml network_info=[{"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:04:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484187802',display_name='tempest-VolumesSnapshotTestJSON-instance-1484187802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484187802',id=20,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgalm70Am1Z7HJ6oLjpp5BlMLqeYpfwEbqg04asyr9hgLiW+iFQLqTHDdOv92J08BCx+KlKnQiMFy0tnM04TyHIaluoPXRoBrlZvxjaM9bLgzCAL8UxRT6OnimI8IikJQ==',key_name='tempest-keypair-1282873152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-4mqi7m0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:04:10 user nova-compute[72894]:   <uuid>6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959</uuid>
Aug 16 20:04:10 user nova-compute[72894]:   <name>instance-00000014</name>
Aug 16 20:04:10 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:04:10 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:04:10 user nova-compute[72894]:   <metadata>
Aug 16 20:04:10 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:04:10 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1484187802</nova:name>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:04:10</nova:creationTime>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:04:10 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:04:10 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:owner>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:user uuid="6c230d020ad34a1588a93fd4a010750c">tempest-VolumesSnapshotTestJSON-762102976-project-member</nova:user>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:project uuid="b407241100354a8a97202de4aae0e75c">tempest-VolumesSnapshotTestJSON-762102976</nova:project>
Aug 16 20:04:10 user nova-compute[72894]:       </nova:owner>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:04:10 user nova-compute[72894]:       <nova:ports>
Aug 16 20:04:10 user nova-compute[72894]:         <nova:port uuid="20b34f9e-63d4-4f5d-b351-0250ca442c21">
Aug 16 20:04:10 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 20:04:10 user nova-compute[72894]:         </nova:port>
Aug 16 20:04:10 user nova-compute[72894]:       </nova:ports>
Aug 16 20:04:10 user nova-compute[72894]:     </nova:instance>
Aug 16 20:04:10 user nova-compute[72894]:   </metadata>
Aug 16 20:04:10 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:04:10 user nova-compute[72894]:     <system>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="serial">6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959</entry>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="uuid">6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959</entry>
Aug 16 20:04:10 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:04:10 user nova-compute[72894]:     </system>
Aug 16 20:04:10 user nova-compute[72894]:   </sysinfo>
Aug 16 20:04:10 user nova-compute[72894]:   <os>
Aug 16 20:04:10 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:04:10 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:04:10 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:04:10 user nova-compute[72894]:   </os>
Aug 16 20:04:10 user nova-compute[72894]:   <features>
Aug 16 20:04:10 user nova-compute[72894]:     <acpi/>
Aug 16 20:04:10 user nova-compute[72894]:     <apic/>
Aug 16 20:04:10 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:04:10 user nova-compute[72894]:   </features>
Aug 16 20:04:10 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:04:10 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:04:10 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:04:10 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:04:10 user nova-compute[72894]:   </clock>
Aug 16 20:04:10 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:04:10 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:04:10 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:04:10 user nova-compute[72894]:   </cpu>
Aug 16 20:04:10 user nova-compute[72894]:   <devices>
Aug 16 20:04:10 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:04:10 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:04:10 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk"/>
Aug 16 20:04:10 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:04:10 user nova-compute[72894]:     </disk>
Aug 16 20:04:10 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:04:10 user nova-compute[72894]:       <mac address="fa:16:3e:7a:78:01"/>
Aug 16 20:04:10 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:04:10 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:04:10 user nova-compute[72894]:       <target dev="tap20b34f9e-63"/>
Aug 16 20:04:10 user nova-compute[72894]:     </interface>
Aug 16 20:04:10 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:04:10 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/console.log" append="off"/>
Aug 16 20:04:10 user nova-compute[72894]:     </serial>
Aug 16 20:04:10 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:04:10 user nova-compute[72894]:     <video>
Aug 16 20:04:10 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:04:10 user nova-compute[72894]:     </video>
Aug 16 20:04:10 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:04:10 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:04:10 user nova-compute[72894]:     </rng>
Aug 16 20:04:10 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:04:10 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:04:10 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:04:10 user nova-compute[72894]:     </memballoon>
Aug 16 20:04:10 user nova-compute[72894]:   </devices>
Aug 16 20:04:10 user nova-compute[72894]: </domain>
Aug 16 20:04:10 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484187802',display_name='tempest-VolumesSnapshotTestJSON-instance-1484187802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484187802',id=20,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgalm70Am1Z7HJ6oLjpp5BlMLqeYpfwEbqg04asyr9hgLiW+iFQLqTHDdOv92J08BCx+KlKnQiMFy0tnM04TyHIaluoPXRoBrlZvxjaM9bLgzCAL8UxRT6OnimI8IikJQ==',key_name='tempest-keypair-1282873152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-4mqi7m0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG os_vif [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20b34f9e-63, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20b34f9e-63, col_values=(('external_ids', {'iface-id': '20b34f9e-63d4-4f5d-b351-0250ca442c21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:78:01', 'vm-uuid': '6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:04:10 user nova-compute[72894]: INFO os_vif [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63')
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No VIF found with MAC fa:16:3e:7a:78:01, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updated VIF entry in instance network info cache for port 20b34f9e-63d4-4f5d-b351-0250ca442c21. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updating instance_info_cache with network_info: [{"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4ada46ea-da88-4a0b-a0f7-dec80a52d2b4 req-4dc62737-54f9-4241-8183-a9bbdbb581e4 service nova] Releasing lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:11 user nova-compute[72894]: INFO nova.compute.manager [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Unrescuing
Aug 16 20:04:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:11 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] No waiting events found dispatching network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:12 user nova-compute[72894]: WARNING nova.compute.manager [req-41cca2df-23a1-468d-854a-b813a1080704 req-686452e0-1242-405a-972e-5d2f94c9d89c service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received unexpected event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 for instance with vm_state building and task_state spawning.
Aug 16 20:04:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'flavor' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216238.246583, 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:13 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] VM Stopped (Lifecycle Event)
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ec03340c-13bc-46a5-a03e-10516aafe5b0 None None] [instance: 35f08fa1-d2f2-4f51-b588-fbb30f1d5d54] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:13 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance destroyed successfully.
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216253.93396, 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:13 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] VM Resumed (Lifecycle Event)
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:13 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Instance spawned successfully.
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:04:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:04:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216253.935215, 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] VM Started (Lifecycle Event)
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:04:14 user nova-compute[72894]: INFO nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:14 user nova-compute[72894]: INFO nova.compute.manager [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Took 7.12 seconds to build instance.
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d3d82b8c-fbcb-40d8-ace7-9a1aa4d1704a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.256s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] No waiting events found dispatching network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:14 user nova-compute[72894]: WARNING nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received unexpected event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 for instance with vm_state active and task_state None.
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:14 user nova-compute[72894]: WARNING nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:14 user nova-compute[72894]: WARNING nova.compute.manager [req-985fbcd9-9f01-465f-a5c9-0b66eec36bcd req-ab00e2f2-5a47-4dc7-a637-6f0754b38215 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:16 user nova-compute[72894]: WARNING nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:04:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:16 user nova-compute[72894]: WARNING nova.compute.manager [req-35a2c52a-9df6-4a07-917c-a07604706e24 req-10049b2f-c1e0-4482-90be-68dcbd7b8d9a service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 133d92d6-70ca-4d7e-90d1-4edd276e716f due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216257.639327, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Resumed (Lifecycle Event)
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14ac8fb6-fe07-46a1-863a-6fb7ae6982ef tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216257.640772, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Started (Lifecycle Event)
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:04:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:20 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216245.9461873, 280e6782-15c7-4a5d-8026-716edb653428 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:04:20 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 280e6782-15c7-4a5d-8026-716edb653428] VM Stopped (Lifecycle Event)
Aug 16 20:04:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7bc86d5e-c55f-4d2f-835b-4bf047f33647 None None] [instance: 280e6782-15c7-4a5d-8026-716edb653428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:04:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:04:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing instance network info cache due to event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.network.neutron [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:04:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=6937MB free_disk=24.44922637939453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 2073e7a0-b213-44da-9249-47ace2f78b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7b2c0761-d8f9-411b-8df7-9f79795029fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance aa07273d-a81d-4684-a12c-2f1f24fb1c9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:04:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updated VIF entry in instance network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-644c6f5d-427f-4215-902d-9716108e4aa5 req-e857dea9-916a-46b7-bbb5-f683375daee9 service nova] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:04:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:45 user nova-compute[72894]: INFO nova.compute.manager [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Shelving
Aug 16 20:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:45 user nova-compute[72894]: WARNING nova.compute.manager [req-b251ef36-577b-479c-af35-9a7970869f75 req-e7273f3f-1d7f-4262-b02f-97e08410323e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state active and task_state shelving.
Aug 16 20:04:46 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance destroyed successfully.
Aug 16 20:04:46 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Beginning cold snapshot process
Aug 16 20:04:46 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk /opt/stack/data/nova/instances/snapshots/tmpd0hda9pe/49c01fdb5add4d6ea6caec031a9c42de {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk /opt/stack/data/nova/instances/snapshots/tmpd0hda9pe/49c01fdb5add4d6ea6caec031a9c42de" returned: 0 in 0.655s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:46 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Snapshot extracted, beginning image upload
Aug 16 20:04:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:47 user nova-compute[72894]: INFO nova.compute.manager [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Terminating instance
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:47 user nova-compute[72894]: WARNING nova.compute.manager [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-changed-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Refreshing instance network info cache due to event network-changed-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Acquiring lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Acquired lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Refreshing network info cache for port df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-unplugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] No waiting events found dispatching network-vif-unplugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf3b8936-38a6-4bd4-a039-f2c53d04bd51 req-b10f87a3-04fa-4583-86ce-81968d9be1a9 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-unplugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:04:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Instance destroyed successfully.
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid aa07273d-a81d-4684-a12c-2f1f24fb1c9e {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-888930515',display_name='tempest-TestVolumeBootPattern-server-888930515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-888930515',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-vmquv5kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:03:27Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=aa07273d-a81d-4684-a12c-2f1f24fb1c9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "address": "fa:16:3e:44:ea:f4", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a6432c-f4", "ovs_interfaceid": "c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_vif [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8a6432c-f4, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:48 user nova-compute[72894]: INFO os_vif [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ea:f4,bridge_name='br-int',has_traffic_filtering=True,id=c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a6432c-f4')
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTMaSlYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:04:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a767b-3d59-4370-9cb3-0b78c1f9cdb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f8f32-c7f2-49d0-8b21-e0d879340e51]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:04:48 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:04:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990486950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b0878b-7b1d-46f5-b275-a48de83c5bdc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0ac701-8ff1-44ab-bad7-c8f77810594b]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[405c1d2d-b780-4178-bdef-1a32f3dc6ac0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updated VIF entry in instance network info cache for port df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updating instance_info_cache with network_info: [{"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c29ddc-0b63-4246-8e1e-e1910b96d88e req-279719e6-c842-494f-a9dd-bf159ca47ce9 service nova] Releasing lock "refresh_cache-7b2c0761-d8f9-411b-8df7-9f79795029fd" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777cf5c-a843-432b-878c-3c12890e9156]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23537616536613262', '/dev/disk/by-id/scsi-1SCST_BIO30d40162-57ae6a2b51ea8ef0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_30d40162') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:04:48 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23537616536613262
Aug 16 20:04:48 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO30d40162-57ae6a2b51ea8ef0
Aug 16 20:04:48 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_30d40162
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87928db3-43e7-42dc-ac1c-9a822979e61f]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'flavor' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6644fb6-f514-42cf-8aec-dfb8bd75dcbe]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27582cb-bd91-4efc-ab18-22b5e32b56f8]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260]
Aug 16 20:04:48 user nova-compute[72894]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4, portal: 172.16.0.220,3260] successful.
Aug 16 20:04:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704f6ad0-4027-439f-8c5d-0aae52932ea4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9278fdc0-d208-42ec-a36c-06572220c85c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (367ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:04:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:04:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Deleting instance files /opt/stack/data/nova/instances/aa07273d-a81d-4684-a12c-2f1f24fb1c9e_del
Aug 16 20:04:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Deletion of /opt/stack/data/nova/instances/aa07273d-a81d-4684-a12c-2f1f24fb1c9e_del complete
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.compute.manager [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attaching volume f18a2f96-6833-4400-a263-7609e29a3cb3 to /dev/vdb
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.compute.manager [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Unshelving
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.compute.manager [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.utils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadcf449-6583-4f61-8217-feceb07c1ca3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.virt.block_device [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Booting with volume 962748d6-0dd6-4d49-88af-0a5065fdb942 at /dev/vda
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afaf085-51bb-426f-971a-1c6515995ba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da8d86d-183b-41d5-9548-4b751744844f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb22d59b-12e7-4ad7-9e2d-310c9c2608d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.utils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa37ea13-f0f2-4ec9-8ba9-0f90459eba46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:04:49 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a741a58-afb9-4ac9-a27f-1daf0d27afab]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.utils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updating existing volume attachment record: 8421b42f-00c2-4ba5-8d43-757db1124f60 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7414f75-cae3-48cd-85e6-467747a645b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f950329-fd9b-4b1d-9a43-eb1e7f5f661c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b63465-f850-4012-8567-440f4316d660]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:04:49 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7327b4f-9a73-484b-b701-24d14550716c]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG os_brick.utils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating existing volume attachment record: 2d61b674-4dca-45af-80e1-4b9d2d2948e4 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Snapshot image upload complete
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Took 0.51 seconds to deallocate network for instance.
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.compute.manager [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Shelve offloading
Aug 16 20:04:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance destroyed successfully.
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:04:49 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-0a6990f8-4a1c-488b-810c-d17c79e6d620 req-a5b13a15-39df-49fc-878f-b257ce4a1448 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-deleted-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] Acquiring lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] No waiting events found dispatching network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:04:50 user nova-compute[72894]: WARNING nova.compute.manager [req-cecd986c-fdba-4799-9eb3-6efc7049f630 req-ed383259-d05d-4ea4-abab-df0277a2d539 service nova] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Received unexpected event network-vif-plugged-c8a6432c-f4f2-4d06-bc27-9a1bab8f2bc0 for instance with vm_state active and task_state deleting.
Aug 16 20:04:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance destroyed successfully.
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'resources' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuRbQ6N07kpVQdNWXxKjjhMnNk8l82FaLiXr7JemPfFPYqUm9+8nVNBPG07c5ZLgZyLfQpN2/vZy3mSP/uw9M0RWzh6GGwT9FqyP0Qt3bq3eM5XA/m3HXHkAhEIMNJUPw==',key_name='tempest-keypair-480767158',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:04:49.556247',shelved_host='user',shelved_image_id='5171f58a-3de2-4680-bac3-3907e52ae459'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG os_vif [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap811bf633-15, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:04:50 user nova-compute[72894]: INFO os_vif [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15')
Aug 16 20:04:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Deleting instance files /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84_del
Aug 16 20:04:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Deletion of /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84_del complete
Aug 16 20:04:50 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Deleted allocations for instance 2073e7a0-b213-44da-9249-47ace2f78b84
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:04:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'numa_topology' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:04:51 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:04:51 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:04:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4fc5922f-88da-4072-9167-5d6d17f83dc1 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.207s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:04:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:00 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[af88fea7-87e9-4a49-9e4c-7a9a6084477d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:05:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c7b59d-ad95-41a2-8d23-154586bf1745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3] added
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd461c-0d2d-447a-8388-730cbf669e24]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[36953dec-894c-4c64-a8ad-ae825895ca4e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUdLDpmW {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUdLDpmW" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b83bcd-6a14-4e87-8b03-7e20c4c246d7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUdLDpmW'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[04687bf4-c510-4fcc-9b32-e583c40bd215]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b390fa-6c40-4e87-88c3-640c19c57e38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbe6df5-2ae4-4ecf-a739-27a556c592cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]
Aug 16 20:05:00 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e0617-1616-4fde-bade-d916c934b0a0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d23e1-81a1-4737-be03-8f498f622150]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84275e64-5a9b-4456-8c3c-77963d328728]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:00 user nova-compute[72894]: INFO nova.compute.manager [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Took 11.20 seconds to detach 1 volumes for instance.
Aug 16 20:05:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Deleting volume: 704f6ad0-4027-439f-8c5d-0aae52932ea4 {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216286.0162983, 2073e7a0-b213-44da-9249-47ace2f78b84 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:01 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Stopped (Lifecycle Event)
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-8adf3e5e-7d51-4929-9b7b-a7c4edf28d3f None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.016s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'pci_requests' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'numa_topology' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:05:01 user nova-compute[72894]: INFO nova.compute.claims [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Claim successful on node user
Aug 16 20:05:01 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance aa07273d-a81d-4684-a12c-2f1f24fb1c9e
Aug 16 20:05:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23236613166303037', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236613166303037', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4746f254-b3d6-4d91-a419-4213d512599a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "aa07273d-a81d-4684-a12c-2f1f24fb1c9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.850s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'flavor' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:05:01 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:05:01 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:05:01 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:05:01 user nova-compute[72894]:   <serial>f18a2f96-6833-4400-a263-7609e29a3cb3</serial>
Aug 16 20:05:01 user nova-compute[72894]: </disk>
Aug 16 20:05:01 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:01 user nova-compute[72894]: INFO nova.network.neutron [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:05:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] No VIF found with MAC fa:16:3e:bb:a8:8b, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a20cca-ef28-4516-ad28-9ceb95e549e3 tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG nova.compute.manager [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing instance network info cache due to event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.utils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ccb42-b250-4ecf-ae84-d852acbd77a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[468306ed-2d7e-41c9-b6a7-ec17fc8c7608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1cfca-2b89-4f92-b335-605b43c115fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c140b6-c93a-4d20-9ea3-8f1050f31259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:03 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e0eb9-88cc-4da9-8329-7df3ca957bde]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.utils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:03 user nova-compute[72894]: INFO nova.compute.manager [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Swapping volume f18a2f96-6833-4400-a263-7609e29a3cb3 for 404eac2f-9a22-4d34-ae6c-04d721544e24
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:05:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Creating image(s)
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Ensure instance console log exists: /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start _get_guest_xml network_info=[{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '2d61b674-4dca-45af-80e1-4b9d2d2948e4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58ff42d5-d55e-4d30-b71a-2c64b22b35a3', 'attached_at': '', 'detached_at': '', 'volume_id': '962748d6-0dd6-4d49-88af-0a5065fdb942', 'serial': '962748d6-0dd6-4d49-88af-0a5065fdb942'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:05:03 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:03 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216288.3929815, aa07273d-a81d-4684-a12c-2f1f24fb1c9e => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:03 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] VM Stopped (Lifecycle Event)
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-748824ca-a55f-44af-932b-46ffc4265f06 None None] [instance: aa07273d-a81d-4684-a12c-2f1f24fb1c9e] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:03 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40150a-9acc-4796-ba5f-d882031d5058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:05:03 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58ef004-a46a-4af8-b814-a57e1443e9bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942] added
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e66e3-e14e-48bf-9eeb-d3ef6da1deca]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd789d-aa57-4b59-9e28-f5f4aea52223]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWJolnAS {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWJolnAS" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[506a0360-f5cc-439a-897e-22277397e23c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWJolnAS'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f065e-7ea2-4152-8055-91b98dd2c4b3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0698ec4d-e8d8-419b-9753-896eb1ea5a4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ac1f00-b852-4e8c-a30b-ae1aa23ceb7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]
Aug 16 20:05:03 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39d23d-0ac5-4f46-87e5-ef4e20d3b549]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a54205-68a5-4e6a-b8ba-bf40413e44d4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f000a-9021-45c6-a64f-c2c3eac43f52]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated VIF entry in instance network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:05:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da1b2c0-a363-4c4c-85cd-6f90651db3f2 req-50e08399-d29d-4ce6-bac9-3fbfbf5b703d service nova] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23265633832376163', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265633832376163', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-37858656',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:49Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'pci_devices' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:05:04 user nova-compute[72894]:   <uuid>58ff42d5-d55e-4d30-b71a-2c64b22b35a3</uuid>
Aug 16 20:05:04 user nova-compute[72894]:   <name>instance-0000000b</name>
Aug 16 20:05:04 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:05:04 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:05:04 user nova-compute[72894]:   <metadata>
Aug 16 20:05:04 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:05:04 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:05:04 user nova-compute[72894]:       <nova:name>tempest-TestShelveInstance-server-458187134</nova:name>
Aug 16 20:05:04 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:05:03</nova:creationTime>
Aug 16 20:05:04 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:05:04 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:05:04 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:05:04 user nova-compute[72894]:       <nova:owner>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:user uuid="3d2f3c49803349e8a00bbfaa2f719f85">tempest-TestShelveInstance-1481575186-project-member</nova:user>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:project uuid="610a8e08203746ce83219f039ef1c99e">tempest-TestShelveInstance-1481575186</nova:project>
Aug 16 20:05:04 user nova-compute[72894]:       </nova:owner>
Aug 16 20:05:04 user nova-compute[72894]:       <nova:ports>
Aug 16 20:05:04 user nova-compute[72894]:         <nova:port uuid="5c4317ba-fb95-423b-bf5c-94cfd816ffd0">
Aug 16 20:05:04 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:05:04 user nova-compute[72894]:         </nova:port>
Aug 16 20:05:04 user nova-compute[72894]:       </nova:ports>
Aug 16 20:05:04 user nova-compute[72894]:     </nova:instance>
Aug 16 20:05:04 user nova-compute[72894]:   </metadata>
Aug 16 20:05:04 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:05:04 user nova-compute[72894]:     <system>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="serial">58ff42d5-d55e-4d30-b71a-2c64b22b35a3</entry>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="uuid">58ff42d5-d55e-4d30-b71a-2c64b22b35a3</entry>
Aug 16 20:05:04 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:05:04 user nova-compute[72894]:     </system>
Aug 16 20:05:04 user nova-compute[72894]:   </sysinfo>
Aug 16 20:05:04 user nova-compute[72894]:   <os>
Aug 16 20:05:04 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:05:04 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:05:04 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:05:04 user nova-compute[72894]:   </os>
Aug 16 20:05:04 user nova-compute[72894]:   <features>
Aug 16 20:05:04 user nova-compute[72894]:     <acpi/>
Aug 16 20:05:04 user nova-compute[72894]:     <apic/>
Aug 16 20:05:04 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:05:04 user nova-compute[72894]:   </features>
Aug 16 20:05:04 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:05:04 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:05:04 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:05:04 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:05:04 user nova-compute[72894]:   </clock>
Aug 16 20:05:04 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:05:04 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:05:04 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:05:04 user nova-compute[72894]:   </cpu>
Aug 16 20:05:04 user nova-compute[72894]:   <devices>
Aug 16 20:05:04 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:05:04 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:05:04 user nova-compute[72894]:       <source dev="/dev/sde"/>
Aug 16 20:05:04 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:05:04 user nova-compute[72894]:       <serial>962748d6-0dd6-4d49-88af-0a5065fdb942</serial>
Aug 16 20:05:04 user nova-compute[72894]:     </disk>
Aug 16 20:05:04 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:05:04 user nova-compute[72894]:       <mac address="fa:16:3e:25:60:bd"/>
Aug 16 20:05:04 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:05:04 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:05:04 user nova-compute[72894]:       <target dev="tap5c4317ba-fb"/>
Aug 16 20:05:04 user nova-compute[72894]:     </interface>
Aug 16 20:05:04 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:05:04 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3/console.log" append="off"/>
Aug 16 20:05:04 user nova-compute[72894]:     </serial>
Aug 16 20:05:04 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:05:04 user nova-compute[72894]:     <video>
Aug 16 20:05:04 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:05:04 user nova-compute[72894]:     </video>
Aug 16 20:05:04 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:05:04 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:05:04 user nova-compute[72894]:     </rng>
Aug 16 20:05:04 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:05:04 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:05:04 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:05:04 user nova-compute[72894]:     </memballoon>
Aug 16 20:05:04 user nova-compute[72894]:   </devices>
Aug 16 20:05:04 user nova-compute[72894]: </domain>
Aug 16 20:05:04 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-37858656',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:49Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG os_vif [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c4317ba-fb, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c4317ba-fb, col_values=(('external_ids', {'iface-id': '5c4317ba-fb95-423b-bf5c-94cfd816ffd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:60:bd', 'vm-uuid': '58ff42d5-d55e-4d30-b71a-2c64b22b35a3'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:04 user nova-compute[72894]: INFO os_vif [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb')
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:05:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] No VIF found with MAC fa:16:3e:25:60:bd, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:06 user nova-compute[72894]: WARNING nova.compute.manager [req-9a2007f6-053b-4842-b439-8fb28e6ec1fc req-5533c688-6371-4bba-b451-d006629b2fbf service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216308.5490646, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:08 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Resumed (Lifecycle Event)
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:05:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance spawned successfully.
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:05:08 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216308.5529847, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:08 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Started (Lifecycle Event)
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:08 user nova-compute[72894]: WARNING nova.compute.manager [req-6519bbb6-4881-41a0-8605-07a9b56e323b req-8b026acf-7e2b-4984-b37f-f517021150eb service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4658fe4d-82f9-48d8-9175-4cd4dedb607d tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.546s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:22 user nova-compute[72894]: INFO nova.compute.manager [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Rescuing
Aug 16 20:05:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:05:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:05:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG nova.network.neutron [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:23 user nova-compute[72894]: WARNING nova.compute.manager [req-7cadc8d5-140b-416e-bd17-4d3c4f319d97 req-dfeedc4b-d64b-4d22-a692-c5dc5d54d012 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state active and task_state rescuing.
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance destroyed successfully.
Aug 16 20:05:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Attempting rescue
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:05:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Creating image(s)
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'trusted_certs' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue" returned: 0 in 0.059s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start _get_guest_xml network_info=[{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:4d:8f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '60545238-42c7-459f-80c0-4238accb7183', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'numa_topology' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:24 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'vcpu_model' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1226330475',display_name='tempest-ServerRescueNegativeTestJSON-server-1226330475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1226330475',id=19,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-pzm3fhnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:42Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=af992d03-c0d8-4ebf-92d9-cb51f74a7fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:4d:8f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:4d:8f:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:05:24 user nova-compute[72894]:   <uuid>af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</uuid>
Aug 16 20:05:24 user nova-compute[72894]:   <name>instance-00000013</name>
Aug 16 20:05:24 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:05:24 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:05:24 user nova-compute[72894]:   <metadata>
Aug 16 20:05:24 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:05:24 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1226330475</nova:name>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:05:24</nova:creationTime>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:05:24 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:05:24 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:owner>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:05:24 user nova-compute[72894]:       </nova:owner>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:05:24 user nova-compute[72894]:       <nova:ports>
Aug 16 20:05:24 user nova-compute[72894]:         <nova:port uuid="1d63be3e-9879-4357-bcb6-23772caadd62">
Aug 16 20:05:24 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:05:24 user nova-compute[72894]:         </nova:port>
Aug 16 20:05:24 user nova-compute[72894]:       </nova:ports>
Aug 16 20:05:24 user nova-compute[72894]:     </nova:instance>
Aug 16 20:05:24 user nova-compute[72894]:   </metadata>
Aug 16 20:05:24 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:05:24 user nova-compute[72894]:     <system>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="serial">af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</entry>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="uuid">af992d03-c0d8-4ebf-92d9-cb51f74a7fd2</entry>
Aug 16 20:05:24 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:05:24 user nova-compute[72894]:     </system>
Aug 16 20:05:24 user nova-compute[72894]:   </sysinfo>
Aug 16 20:05:24 user nova-compute[72894]:   <os>
Aug 16 20:05:24 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:05:24 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:05:24 user nova-compute[72894]:   </os>
Aug 16 20:05:24 user nova-compute[72894]:   <features>
Aug 16 20:05:24 user nova-compute[72894]:     <acpi/>
Aug 16 20:05:24 user nova-compute[72894]:     <apic/>
Aug 16 20:05:24 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:05:24 user nova-compute[72894]:   </features>
Aug 16 20:05:24 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:05:24 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:05:24 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:05:24 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:05:24 user nova-compute[72894]:   </clock>
Aug 16 20:05:24 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:05:24 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:05:24 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:05:24 user nova-compute[72894]:   </cpu>
Aug 16 20:05:24 user nova-compute[72894]:   <devices>
Aug 16 20:05:24 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:05:24 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:05:24 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue"/>
Aug 16 20:05:24 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:05:24 user nova-compute[72894]:     </disk>
Aug 16 20:05:24 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:05:24 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:05:24 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk"/>
Aug 16 20:05:24 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:05:24 user nova-compute[72894]:     </disk>
Aug 16 20:05:24 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:05:24 user nova-compute[72894]:       <mac address="fa:16:3e:4d:8f:e9"/>
Aug 16 20:05:24 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:05:24 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:05:24 user nova-compute[72894]:       <target dev="tap1d63be3e-98"/>
Aug 16 20:05:24 user nova-compute[72894]:     </interface>
Aug 16 20:05:24 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:05:24 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/console.log" append="off"/>
Aug 16 20:05:24 user nova-compute[72894]:     </serial>
Aug 16 20:05:24 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:05:24 user nova-compute[72894]:     <video>
Aug 16 20:05:24 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:05:24 user nova-compute[72894]:     </video>
Aug 16 20:05:24 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:05:24 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:05:24 user nova-compute[72894]:     </rng>
Aug 16 20:05:24 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:05:24 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:05:24 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:05:24 user nova-compute[72894]:     </memballoon>
Aug 16 20:05:24 user nova-compute[72894]:   </devices>
Aug 16 20:05:24 user nova-compute[72894]: </domain>
Aug 16 20:05:24 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:05:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance destroyed successfully.
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:4d:8f:e9, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:05:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:25 user nova-compute[72894]: WARNING nova.compute.manager [req-5c5b50f1-8156-4a95-88d1-5ba01f47ab30 req-fecdf847-7425-4513-838c-f231e4833b21 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state active and task_state rescuing.
Aug 16 20:05:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24', 'serial': '404eac2f-9a22-4d34-ae6c-04d721544e24'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f18a2f96-6833-4400-a263-7609e29a3cb3', 'serial'} {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:26 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a85440-a3e5-456b-af09-2c6cfe57a314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:05:26 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a0d226-4b51-4e45-bf53-f9e42171c6e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24] added
Aug 16 20:05:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[45648b2b-a5da-42dd-a0d6-2d1deec158ae]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde0fc8-ecb1-4f61-9412-a1c6f1a17457]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xatfzCjG {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xatfzCjG" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[af677fa6-e2a8-4730-ab6c-6a5dc495f2ad]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xatfzCjG'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[938e2810-6efe-4756-9495-e79879fa118d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d6f135-aa45-4085-90c9-0ab2ff625e07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --login" returned: 0 in 1.107s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604bcb0-88a0-4042-9eec-fa0676898183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260]
Aug 16 20:05:27 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260] successful.
Aug 16 20:05:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b50fc6-593a-41aa-a7d2-7589f0d94849]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d6384-2682-4972-852f-88327785b4c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.422s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[02513c36-4449-4ba8-8924-5b7c5d91ba44]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:27 user nova-compute[72894]: WARNING nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state active and task_state rescuing.
Aug 16 20:05:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:05:27 user nova-compute[72894]: WARNING nova.compute.manager [req-b43595ce-26f7-4961-8f29-f9dcd048e09e req-3915c78d-b276-458c-a30c-c93ac70bc94a service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state active and task_state rescuing.
Aug 16 20:05:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.469s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== connect_volume: return (2470ms) {'type': 'block', 'scsi_wwn': '23335306139333564', 'path': '/dev/sdg'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335306139333564', 'path': '/dev/sdg'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:05:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lazy-loading 'flavor' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216329.9276917, af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] VM Resumed (Lifecycle Event)
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-8241f51e-2420-4340-928b-86cf139f90f3 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:05:30 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:05:30 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216329.9294937, af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:05:30 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] VM Started (Lifecycle Event)
Aug 16 20:05:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:05:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:05:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 284164096 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 449839104 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 745537536 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:34 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c67b22-82d1-48ea-b144-92f03095a2b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df057b8e-1ae0-49ed-99ea-af8107081851]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec57069a-951f-4e51-99d2-673976f6b662 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990602ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3036c0-cfa3-4b32-9b2e-1b2f996104cd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ec792-297a-4a00-a53c-64150f1a996e]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4e719-4600-4e87-b155-c7db8d450abe]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c94944d-bf54-483f-b4e5-ba2c8e866597]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fae146-735c-4d50-833d-1417e09f51f9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe951222-bfc8-4eb7-bc7c-9e4d1c38cc08]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]
Aug 16 20:05:34 user nova-compute[72894]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.
Aug 16 20:05:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc15cb-33b3-4a6b-91c7-7d5503a9b958]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== disconnect_volume: return (419ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24', 'serial'} {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: removing Cinder connection for volume f18a2f96-6833-4400-a263-7609e29a3cb3 {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 20:05:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: Updating volume f18a2f96-6833-4400-a263-7609e29a3cb3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "xatfzCjG", "auth_password": "HglSr7JRajVb9i", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "404eac2f-9a22-4d34-ae6c-04d721544e24"}, "status": "reserved", "instance": "7b2c0761-d8f9-411b-8df7-9f79795029fd", "attached_at": "", "detached_at": "", "volume_id": "404eac2f-9a22-4d34-ae6c-04d721544e24", "serial": "404eac2f-9a22-4d34-ae6c-04d721544e24"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24', 'no_device': None, 'attachment_id': '603bb5fd-781f-459a-9ea7-1d07dd7eadc0'} {{(pid=72894) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 20:05:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1fc61421-1472-430f-988c-0587e22844f6 tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.537s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.utils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd87b5-483e-47b4-9e55-588cc45b358d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d20af1-336a-42eb-8a9f-31951bb5b8aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06929b10-cb35-484e-a502-807116fb49d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd634b6-3729-40c6-9783-f2951b941154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:36 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:05:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213ea22-fd55-4710-914d-784f936d7054]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:05:36 user nova-compute[72894]: DEBUG os_brick.utils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:36 user nova-compute[72894]: INFO nova.compute.manager [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Swapping volume 404eac2f-9a22-4d34-ae6c-04d721544e24 for f18a2f96-6833-4400-a263-7609e29a3cb3
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=23.413955688476562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 12dd204d-9368-47c2-88e2-8d97ff942621 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7b2c0761-d8f9-411b-8df7-9f79795029fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:05:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:05:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:05:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:05:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:05:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:05:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:05:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-changed-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Refreshing instance network info cache due to event network-changed-20b34f9e-63d4-4f5d-b351-0250ca442c21. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] Acquiring lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] Acquired lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.network.neutron [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Refreshing network info cache for port 20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:05:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Ignoring supplied device name: /dev/vdb
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.network.neutron [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updated VIF entry in instance network info cache for port 20b34f9e-63d4-4f5d-b351-0250ca442c21. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG nova.network.neutron [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updating instance_info_cache with network_info: [{"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:05:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:05:58 user nova-compute[72894]: INFO nova.compute.manager [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Attaching volume 0d2a3667-74ed-480c-a16f-1187f95ea0dc to /dev/vdb
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8938a03e-b5f4-4f32-94a2-e2332e5ddc2a req-5ae08931-d680-41af-a108-0edd31a6879b service nova] Releasing lock "refresh_cache-6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.utils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e753b8-10ba-4823-b116-0a2a320af847]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfee84d-2ff8-4094-adf3-e5eac0541c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71cb23-d5f7-4dc5-b962-c1dc08c37a24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13f020-a213-43eb-a2b2-3fefa1a26061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:05:59 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c8fb01-c369-41b1-b0fb-a52d24c399d1]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.utils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updating existing volume attachment record: 9d2ea641-1acf-45ac-9e0c-6e770a5fe08c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f18a2f96-6833-4400-a263-7609e29a3cb3', 'serial': 'f18a2f96-6833-4400-a263-7609e29a3cb3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24'}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24', 'serial'} {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:05:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:05:59 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6cef6-abc7-4bd0-b924-aa590762d43d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:05:59 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[59290f23-6c36-4102-807d-5a512fc454b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3] added
Aug 16 20:05:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509ea2c-3d3c-4b21-b9d4-b20c18684342]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a936c3-b91d-4761-82bb-374826439ff6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUdLDpmW {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUdLDpmW" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[02021244-6cd5-4eec-8a37-4250be19f969]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUdLDpmW'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a1bbf0-6e4e-458b-acfc-7ae7e7b31514]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf9529-9147-4ec0-a736-3c399d834656]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:05:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:05:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.196s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51e11e1-2cc3-4fb1-8473-2a1f62828a31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]
Aug 16 20:06:00 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b765de-c070-40d7-aea8-6f1405798a91]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c57835e-e87c-4de7-bb4c-1fccfb002a61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e84ab85-2f9a-4ae0-bb26-b12dcb192767]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:06:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:06:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '23236613166303037', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236613166303037', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:06:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lazy-loading 'flavor' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 593494016 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 739246080 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 895483904 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:04 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:06:04 user nova-compute[72894]: INFO nova.compute.claims [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Claim successful on node user
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:06:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.policy [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c9bdeca6ea84622835b26c7565f148c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0853a75dd30c499288bb5e848f038580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:06:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Creating image(s)
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "/opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xatfzCjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '404eac2f-9a22-4d34-ae6c-04d721544e24'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:05 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c265906-244e-485d-9e8e-b67ca15fe631]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf5fda-4200-432d-b36b-f12478507e9c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:05 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799066cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24'): ({'sdg'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Removing single pathed devices sdg {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4ee8c-effd-459d-baea-bf6031a7fe42]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7c909-b450-4324-90be-bc978c6b54eb]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Flushing IO for device /dev/sdg {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df9304-0b9a-4b08-b7ea-df09b38be934]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea2fb3-9b02-4b93-9014-e0f9b9ed3705]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] SCSI volumes sdg have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b0dab-f050-402f-a7f7-5ace4e654bf8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.221s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[799966a0-c7b5-4bae-ae68-3a1d35128407]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260]
Aug 16 20:06:06 user nova-compute[72894]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk 1073741824" returned: 0 in 0.096s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404eac2f-9a22-4d34-ae6c-04d721544e24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4035486-3c3e-4489-93bd-a750dfecfc31]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] <== disconnect_volume: return (512ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7b2c0761-d8f9-411b-8df7-9f79795029fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f18a2f96-6833-4400-a263-7609e29a3cb3', 'serial'} {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: removing Cinder connection for volume 404eac2f-9a22-4d34-ae6c-04d721544e24 {{(pid=72894) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Successfully created port: 2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Cannot resize image /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'migration_context' on Instance uuid d08b5d90-e83b-4894-8507-a5904a9f7098 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Ensure instance console log exists: /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] swap_volume: Updating volume 404eac2f-9a22-4d34-ae6c-04d721544e24 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "kUdLDpmW", "auth_password": "Aja8qZIEUTvxhX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "f18a2f96-6833-4400-a263-7609e29a3cb3"}, "status": "reserved", "instance": "7b2c0761-d8f9-411b-8df7-9f79795029fd", "attached_at": "", "detached_at": "", "volume_id": "f18a2f96-6833-4400-a263-7609e29a3cb3", "serial": "f18a2f96-6833-4400-a263-7609e29a3cb3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f18a2f96-6833-4400-a263-7609e29a3cb3', 'no_device': None, 'attachment_id': '9f07ab64-45e9-411a-9a55-a7e4163458f8'} {{(pid=72894) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Successfully updated port: 2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-66be76a7-3a70-4286-a02b-35fadb186ccf tempest-TestVolumeSwap-2050415377 tempest-TestVolumeSwap-2050415377-project-admin] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.111s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-changed-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Refreshing instance network info cache due to event network-changed-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] Acquiring lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updating instance_info_cache with network_info: [{"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Instance network_info: |[{"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] Acquired lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.neutron [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Refreshing network info cache for port 2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Start _get_guest_xml network_info=[{"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:06:07 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:07 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-515326161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-515326161',id=21,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-a6svgju6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:06Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=d08b5d90-e83b-4894-8507-a5904a9f7098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid d08b5d90-e83b-4894-8507-a5904a9f7098 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:06:08 user nova-compute[72894]:   <uuid>d08b5d90-e83b-4894-8507-a5904a9f7098</uuid>
Aug 16 20:06:08 user nova-compute[72894]:   <name>instance-00000015</name>
Aug 16 20:06:08 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:06:08 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:06:08 user nova-compute[72894]:   <metadata>
Aug 16 20:06:08 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:06:08 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-515326161</nova:name>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:06:07</nova:creationTime>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:06:08 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:06:08 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:owner>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 20:06:08 user nova-compute[72894]:       </nova:owner>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:06:08 user nova-compute[72894]:       <nova:ports>
Aug 16 20:06:08 user nova-compute[72894]:         <nova:port uuid="2cf064b8-7baf-40d3-94d8-d8d1670f7b2d">
Aug 16 20:06:08 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 20:06:08 user nova-compute[72894]:         </nova:port>
Aug 16 20:06:08 user nova-compute[72894]:       </nova:ports>
Aug 16 20:06:08 user nova-compute[72894]:     </nova:instance>
Aug 16 20:06:08 user nova-compute[72894]:   </metadata>
Aug 16 20:06:08 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:06:08 user nova-compute[72894]:     <system>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="serial">d08b5d90-e83b-4894-8507-a5904a9f7098</entry>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="uuid">d08b5d90-e83b-4894-8507-a5904a9f7098</entry>
Aug 16 20:06:08 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:06:08 user nova-compute[72894]:     </system>
Aug 16 20:06:08 user nova-compute[72894]:   </sysinfo>
Aug 16 20:06:08 user nova-compute[72894]:   <os>
Aug 16 20:06:08 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:06:08 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:06:08 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:06:08 user nova-compute[72894]:   </os>
Aug 16 20:06:08 user nova-compute[72894]:   <features>
Aug 16 20:06:08 user nova-compute[72894]:     <acpi/>
Aug 16 20:06:08 user nova-compute[72894]:     <apic/>
Aug 16 20:06:08 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:06:08 user nova-compute[72894]:   </features>
Aug 16 20:06:08 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:06:08 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:06:08 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:06:08 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:06:08 user nova-compute[72894]:   </clock>
Aug 16 20:06:08 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:06:08 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:06:08 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:06:08 user nova-compute[72894]:   </cpu>
Aug 16 20:06:08 user nova-compute[72894]:   <devices>
Aug 16 20:06:08 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:06:08 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:06:08 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk"/>
Aug 16 20:06:08 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:06:08 user nova-compute[72894]:     </disk>
Aug 16 20:06:08 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:06:08 user nova-compute[72894]:       <mac address="fa:16:3e:6a:6d:d1"/>
Aug 16 20:06:08 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:06:08 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:06:08 user nova-compute[72894]:       <target dev="tap2cf064b8-7b"/>
Aug 16 20:06:08 user nova-compute[72894]:     </interface>
Aug 16 20:06:08 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:06:08 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/console.log" append="off"/>
Aug 16 20:06:08 user nova-compute[72894]:     </serial>
Aug 16 20:06:08 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:06:08 user nova-compute[72894]:     <video>
Aug 16 20:06:08 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:06:08 user nova-compute[72894]:     </video>
Aug 16 20:06:08 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:06:08 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:06:08 user nova-compute[72894]:     </rng>
Aug 16 20:06:08 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:06:08 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:06:08 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:06:08 user nova-compute[72894]:     </memballoon>
Aug 16 20:06:08 user nova-compute[72894]:   </devices>
Aug 16 20:06:08 user nova-compute[72894]: </domain>
Aug 16 20:06:08 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-515326161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-515326161',id=21,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-a6svgju6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:06Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=d08b5d90-e83b-4894-8507-a5904a9f7098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG os_vif [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf064b8-7b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cf064b8-7b, col_values=(('external_ids', {'iface-id': '2cf064b8-7baf-40d3-94d8-d8d1670f7b2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:6d:d1', 'vm-uuid': 'd08b5d90-e83b-4894-8507-a5904a9f7098'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:08 user nova-compute[72894]: INFO os_vif [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b')
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:6a:6d:d1, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:08 user nova-compute[72894]: INFO nova.compute.manager [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Detaching volume f18a2f96-6833-4400-a263-7609e29a3cb3
Aug 16 20:06:08 user nova-compute[72894]: INFO nova.virt.block_device [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Attempting to driver detach volume f18a2f96-6833-4400-a263-7609e29a3cb3 from mountpoint /dev/vdb
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Attempting to detach device vdb from instance 7b2c0761-d8f9-411b-8df7-9f79795029fd from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:06:08 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:08 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:06:08 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:06:08 user nova-compute[72894]:   <serial>f18a2f96-6833-4400-a263-7609e29a3cb3</serial>
Aug 16 20:06:08 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:06:08 user nova-compute[72894]: </disk>
Aug 16 20:06:08 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:06:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Successfully detached device vdb from instance 7b2c0761-d8f9-411b-8df7-9f79795029fd from the persistent domain config.
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b2c0761-d8f9-411b-8df7-9f79795029fd from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:06:08 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:08 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:06:08 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:06:08 user nova-compute[72894]:   <serial>f18a2f96-6833-4400-a263-7609e29a3cb3</serial>
Aug 16 20:06:08 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:06:08 user nova-compute[72894]: </disk>
Aug 16 20:06:08 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updated VIF entry in instance network info cache for port 2cf064b8-7baf-40d3-94d8-d8d1670f7b2d. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updating instance_info_cache with network_info: [{"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a36ee836-595b-4c31-89c4-7ca28ca9247d req-1c9ef93c-d6eb-47c2-96b8-793a29380b40 service nova] Releasing lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216369.1077538, 7b2c0761-d8f9-411b-8df7-9f79795029fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:06:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Successfully detached device vdb from instance 7b2c0761-d8f9-411b-8df7-9f79795029fd from the live domain config.
Aug 16 20:06:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUdLDpmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'f18a2f96-6833-4400-a263-7609e29a3cb3'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[602d53aa-038e-4791-8e4f-fa924b1ecbcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[01502fbc-9f04-4bbb-b1e7-b0420846345b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 (non-flash)
Aug 16 20:06:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990495ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ed979-6d86-4d5b-bfaa-da61a24624a2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be1071-4cb1-42d6-81a2-2bb7733da378]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[232913ba-4f00-4658-8caf-7e9efde2c634]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c209e3-80e6-41ae-92ae-a3759e151a18]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f938e2c5-2d34-4131-b666-7d0a6a06aabc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d060f4-07a1-4ce6-aab5-d6b60df7f518]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260]
Aug 16 20:06:09 user nova-compute[72894]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18a2f96-6833-4400-a263-7609e29a3cb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa2d8e9-7f39-46c4-8002-300285512c71]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] <== disconnect_volume: return (328ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] No waiting events found dispatching network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:10 user nova-compute[72894]: WARNING nova.compute.manager [req-03fd8cbc-2816-49ce-8843-fa387ae72b25 req-dfc35dbe-fe16-44e4-bcd5-92c6b5973db9 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received unexpected event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d for instance with vm_state building and task_state spawning.
Aug 16 20:06:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'flavor' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-17c36a01-bc23-46ea-8ffc-429be5f78b9f tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.225s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] No waiting events found dispatching network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:12 user nova-compute[72894]: WARNING nova.compute.manager [req-e8da3554-deec-4a21-b586-46a6554a4918 req-78a362c0-544e-4ca9-8771-8abfd090908d service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received unexpected event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d for instance with vm_state building and task_state spawning.
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216372.1718454, d08b5d90-e83b-4894-8507-a5904a9f7098 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] VM Resumed (Lifecycle Event)
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Instance spawned successfully.
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216372.1730034, d08b5d90-e83b-4894-8507-a5904a9f7098 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] VM Started (Lifecycle Event)
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 16 20:06:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:12 user nova-compute[72894]: INFO nova.compute.manager [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Took 7.46 seconds to build instance.
Aug 16 20:06:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3078a3d2-9243-4d8c-adb9-ce301a28b2f1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.602s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIUXhPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:19 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3fea8-63e3-420c-92ce-7be19468b038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:06:19 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96529a-1243-424c-a124-760534792f34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc] added
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd11e4b-b0c3-400c-8743-4ad0201e72a9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f781d900-975b-4b54-a701-9698508d03ec]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIUXhPaw {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIUXhPaw" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3fad65-4c7d-45f4-ad03-730c778056be]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIUXhPaw'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7967ee8a-7870-4712-aa45-4bd7107e808a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f41001-9311-4a7f-9d5c-a47e7ce0194c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1cd94-0306-4687-b1a1-81761b3f39eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260]
Aug 16 20:06:19 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16cdd5a-8d91-435c-8dcf-379e7f259392]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3f084-3fa0-4baf-b6fe-6cad51863e0e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:19 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a2404-9908-4a04-8eeb-d6acdf5c2948]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIUXhPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23064353265363563', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064353265363563', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:06:20 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:20 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:06:20 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:06:20 user nova-compute[72894]:   <serial>0d2a3667-74ed-480c-a16f-1187f95ea0dc</serial>
Aug 16 20:06:20 user nova-compute[72894]: </disk>
Aug 16 20:06:20 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:06:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:06:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:06:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No VIF found with MAC fa:16:3e:7a:78:01, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:06:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-25e3093a-0086-4efc-9aa8-3e777c8d83a3 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.171s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:23 user nova-compute[72894]: INFO nova.compute.manager [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Detaching volume 0d3767e2-4d88-4be6-942e-b3e83303b82f
Aug 16 20:06:23 user nova-compute[72894]: INFO nova.virt.block_device [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Attempting to driver detach volume 0d3767e2-4d88-4be6-942e-b3e83303b82f from mountpoint /dev/vdb
Aug 16 20:06:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Attempting to detach device vdb from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:06:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:06:23 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:23 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:06:23 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:06:23 user nova-compute[72894]:   <serial>0d3767e2-4d88-4be6-942e-b3e83303b82f</serial>
Aug 16 20:06:23 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:06:23 user nova-compute[72894]: </disk>
Aug 16 20:06:23 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:06:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully detached device vdb from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the persistent domain config.
Aug 16 20:06:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:06:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:06:23 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:23 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:06:23 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:06:23 user nova-compute[72894]:   <serial>0d3767e2-4d88-4be6-942e-b3e83303b82f</serial>
Aug 16 20:06:23 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:06:23 user nova-compute[72894]: </disk>
Aug 16 20:06:23 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216384.2741723, ff3a42d6-469e-4194-be6d-eacc72cc87fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:06:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully detached device vdb from instance ff3a42d6-469e-4194-be6d-eacc72cc87fd from the live domain config.
Aug 16 20:06:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfsCNLrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:24 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a67859b-1b6c-42f5-973d-de22bbf6f3b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92f2a0f-be8a-4d9d-bc47-ff024ffec978]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:24 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c675c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d5117-5ece-4c75-bf49-87dfecb322f7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c024580-4422-4a24-a16d-f3d4060f3ce3]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734c8e4-8004-4831-bf45-98b76874a3fe]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac299f9f-678d-466a-9f6c-0074fd92973c]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b98e40-bf55-4e39-a944-73a1c21c529d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb51801d-11fc-44d2-8091-d3a93ffef44d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260]
Aug 16 20:06:24 user nova-compute[72894]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3767e2-4d88-4be6-942e-b3e83303b82f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6642a79b-9da4-44b9-aa79-6088373ec033]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== disconnect_volume: return (308ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:06:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'flavor' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e04b6353-8a66-4cd6-89cc-ac2e1967f68b tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.756s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:06:29 user nova-compute[72894]: INFO nova.compute.claims [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Claim successful on node user
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:06:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:06:30 user nova-compute[72894]: INFO nova.virt.block_device [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Booting with volume c4b66c2b-4ec6-40d5-9aba-827d0e43e562 at /dev/vda
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.policy [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.utils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9bbf14-8ba7-40e7-affa-af6087e98a38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4191d-9a36-4d13-85a2-d0c7563bf036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c6ca9-e950-42f9-a82e-7a8e5dcbe3a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f969f3-fe52-43e2-9c75-e666ce8f8613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:06:30 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:06:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[166113b2-3b1e-4001-9226-924676228f63]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG os_brick.utils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:30 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updating existing volume attachment record: 8b1c21ea-253e-44eb-af2a-071607d86e56 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:06:31 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Successfully created port: b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:06:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Successfully updated port: b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-changed-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Refreshing instance network info cache due to event network-changed-b6f99dea-3695-4b5b-a3b1-52a58e4e4741. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] Acquiring lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updating instance_info_cache with network_info: [{"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Instance network_info: |[{"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] Acquired lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Refreshing network info cache for port b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updated VIF entry in instance network info cache for port b6f99dea-3695-4b5b-a3b1-52a58e4e4741. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updating instance_info_cache with network_info: [{"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d19a53-0e82-4aa0-a292-341d4c530dc5 req-48a6e85a-eac7-48aa-aa37-71a2ac594271 service nova] Releasing lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:35 user nova-compute[72894]: INFO nova.compute.manager [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Terminating instance
Aug 16 20:06:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-ed7ff543-6d8c-41ff-9d1c-c5f129182c74 req-dc1768c8-41e7-460b-8673-adb035581c7a service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-unplugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:06:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Instance destroyed successfully.
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.objects.instance [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lazy-loading 'resources' on Instance uuid 12dd204d-9368-47c2-88e2-8d97ff942621 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1557906681',display_name='tempest-ServerActionsTestOtherB-server-1557906681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1557906681',id=2,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEyH4gt9tMjy4QxTuWCblL7sjIWJye6d4oaCeArLJlpZ2CvUSTmM5mxzB7B5SlgTa5Ehj8FSoqh42MDIChoWSgRaD3QQznypT4Q3BinJBT4lHIlUX0ZzPTw6AgtMna2zA==',key_name='tempest-keypair-1341916628',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71a2a663816647aa9bb26ac44848f40e',ramdisk_id='',reservation_id='r-hys21dxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-85778765',owner_user_name='tempest-ServerActionsTestOtherB-85778765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a82f6efbf71343eca3f5b09517d3a86d',uuid=12dd204d-9368-47c2-88e2-8d97ff942621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converting VIF {"id": "2ea3d08c-315a-4008-917c-b629398a8b98", "address": "fa:16:3e:30:37:0b", "network": {"id": "00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1506989657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71a2a663816647aa9bb26ac44848f40e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea3d08c-31", "ovs_interfaceid": "2ea3d08c-315a-4008-917c-b629398a8b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_vif [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea3d08c-31, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:36 user nova-compute[72894]: INFO os_vif [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:0b,bridge_name='br-int',has_traffic_filtering=True,id=2ea3d08c-315a-4008-917c-b629398a8b98,network=Network(00cdfdc0-bc2b-4c89-a09d-c0469d6e82b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea3d08c-31')
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTxWSRoZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:36 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87466e2a-e237-4261-94e5-3debe88903ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77756e92-131f-4503-a058-f73028c5b352]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:36 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990636ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c5c83-1424-496f-833d-2a20bb94807b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[13640e8c-d0fd-497c-800c-0b9cbbd86b35]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d10263-b753-4f84-99ae-e172481ad927]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[17272dc8-b023-4309-bb30-8f3b82030801]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.091s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296e9db-64c0-429d-935c-aa0d8ccfdd5b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1478b044-3659-4adc-942d-622351a21662]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260]
Aug 16 20:06:36 user nova-compute[72894]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f3c5f5-09ab-464c-9d18-53e44b97f616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2bd8a5-bc24-4e50-b8d0-7e5eabdfba55]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] <== disconnect_volume: return (390ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:06:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Deleting instance files /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_del
Aug 16 20:06:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Deletion of /opt/stack/data/nova/instances/12dd204d-9368-47c2-88e2-8d97ff942621_del complete
Aug 16 20:06:36 user nova-compute[72894]: INFO nova.compute.manager [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 16 20:06:36 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:06:36 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] Acquiring lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] Lock "12dd204d-9368-47c2-88e2-8d97ff942621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] No waiting events found dispatching network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:37 user nova-compute[72894]: WARNING nova.compute.manager [req-9a17a434-1363-450d-aac2-b7253cc00377 req-0a3dd09e-aa23-470b-9275-26894a9f5ae2 service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received unexpected event network-vif-plugged-2ea3d08c-315a-4008-917c-b629398a8b98 for instance with vm_state active and task_state deleting.
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:38 user nova-compute[72894]: INFO nova.compute.manager [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Unshelving
Aug 16 20:06:38 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Took 1.45 seconds to deallocate network for instance.
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: INFO nova.virt.block_device [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Booting with volume 5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 at /dev/vdc
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.utils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f737dc8-f061-47bb-beef-6825e215c7ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae00d7e4-c178-437b-86b4-64c02f8c5d45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d73b50f-67e0-48fb-88db-35559258351c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf2aa6-65f6-489d-b439-758d5e012b31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:06:38 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1649b31-18b3-4ed6-ae62-c2593361f6e6]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG os_brick.utils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating existing volume attachment record: c44c5148-aa7f-446e-843a-5edd6aeaf565 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:38 user nova-compute[72894]: INFO nova.compute.manager [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Took 0.85 seconds to detach 1 volumes for instance.
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:39 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Deleted allocations for instance 12dd204d-9368-47c2-88e2-8d97ff942621
Aug 16 20:06:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-71e45c61-c868-4911-acee-c16435ec20e4 req-7dbecc6e-7325-4a3a-9b12-8f36974deebf service nova] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Received event network-vif-deleted-2ea3d08c-315a-4008-917c-b629398a8b98 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-80c2df1f-1ae7-4730-93fb-fd4aa71bbfab tempest-ServerActionsTestOtherB-85778765 tempest-ServerActionsTestOtherB-85778765-project-member] Lock "12dd204d-9368-47c2-88e2-8d97ff942621" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.652s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing instance network info cache due to event network-changed-5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] Acquiring lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] Acquired lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG nova.network.neutron [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Refreshing network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:40 user nova-compute[72894]: INFO nova.compute.manager [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Terminating instance
Aug 16 20:06:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updated VIF entry in instance network info cache for port 5c4317ba-fb95-423b-bf5c-94cfd816ffd0. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [{"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Instance destroyed successfully.
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lazy-loading 'resources' on Instance uuid 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4b5fd69d-0db4-4d32-b6ce-7ae8e27a85ac req-b334efe8-22f6-44eb-aed3-dae9427364d2 service nova] Releasing lock "refresh_cache-58ff42d5-d55e-4d30-b71a-2c64b22b35a3" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-458187134',display_name='tempest-TestShelveInstance-server-458187134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-458187134',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCIC1lih8ZhTOQnbgqKwnejhzZhSn9ZbbdBeKAtGmF4RIWc3My0AeBFwVh0XOPwawoYZSTtSlGv+CVCKF0Bys5iZoT+K3+qASd46AIDrLO7i4YD55nJ9KhayC9B08IG+A==',key_name='tempest-TestShelveInstance-37858656',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='610a8e08203746ce83219f039ef1c99e',ramdisk_id='',reservation_id='r-9bp7vqxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1481575186',owner_user_name='tempest-TestShelveInstance-1481575186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:05:09Z,user_data=None,user_id='3d2f3c49803349e8a00bbfaa2f719f85',uuid=58ff42d5-d55e-4d30-b71a-2c64b22b35a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converting VIF {"id": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "address": "fa:16:3e:25:60:bd", "network": {"id": "51468acc-df95-4012-a282-279faa459292", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024333235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "610a8e08203746ce83219f039ef1c99e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4317ba-fb", "ovs_interfaceid": "5c4317ba-fb95-423b-bf5c-94cfd816ffd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_vif [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c4317ba-fb, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:41 user nova-compute[72894]: INFO os_vif [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:60:bd,bridge_name='br-int',has_traffic_filtering=True,id=5c4317ba-fb95-423b-bf5c-94cfd816ffd0,network=Network(51468acc-df95-4012-a282-279faa459292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4317ba-fb')
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWJolnAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:41 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef8c6b-890c-4a18-a693-3466cea3dc55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed589a94-554b-40b5-88b1-3d7af843fabc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:41 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:41 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:41 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:41 user nova-compute[72894]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 (non-flash)
Aug 16 20:06:41 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:41 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990437d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf8de4-6597-41ce-a0b7-9bd881ed70cf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96697f-9838-495b-9d09-866c85765932]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6005572b-d23d-484b-adbe-c28d97a4708c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcdade7-6723-48b0-b6cb-e17473c59de0]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8358f5f-64a2-4917-bab4-13adeddb68d1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[19158af0-8e9a-41a2-a947-1faf1a2c76b0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260]
Aug 16 20:06:41 user nova-compute[72894]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:41 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962748d6-0dd6-4d49-88af-0a5065fdb942 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35b6a6-59f8-476e-a46a-08133c12e8fb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] <== disconnect_volume: return (452ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:06:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deleting instance files /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3_del
Aug 16 20:06:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deletion of /opt/stack/data/nova/instances/58ff42d5-d55e-4d30-b71a-2c64b22b35a3_del complete
Aug 16 20:06:41 user nova-compute[72894]: INFO nova.compute.manager [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-unplugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Acquiring lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] No waiting events found dispatching network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:41 user nova-compute[72894]: WARNING nova.compute.manager [req-7d179332-ed63-4372-b861-2bca71194d2c req-a18d5cb1-ec19-413b-97db-aff1dcd89e5e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received unexpected event network-vif-plugged-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 for instance with vm_state active and task_state deleting.
Aug 16 20:06:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=24.407917022705078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:42 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Took 0.82 seconds to deallocate network for instance.
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ff3a42d6-469e-4194-be6d-eacc72cc87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7b2c0761-d8f9-411b-8df7-9f79795029fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 67838895-188d-42ea-9197-a9d8dc841ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 2073e7a0-b213-44da-9249-47ace2f78b84 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:06:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:06:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Creating image(s)
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Ensure instance console log exists: /opt/stack/data/nova/instances/67838895-188d-42ea-9197-a9d8dc841ae5/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Start _get_guest_xml network_info=[{"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '8b1c21ea-253e-44eb-af2a-071607d86e56', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZJHwrpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67838895-188d-42ea-9197-a9d8dc841ae5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4b66c2b-4ec6-40d5-9aba-827d0e43e562', 'serial': 'c4b66c2b-4ec6-40d5-9aba-827d0e43e562'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:06:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZJHwrpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:06:43 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:43 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:06:43 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6a7ee-eddb-4f59-ad3a-a2c12b72b098]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:06:43 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b85f86-5b10-4328-aae0-78ecd52cc09e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562] added
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc02ddf-6b60-443e-875d-bb8829100f2d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c4e6a0-5624-465e-b20d-a97a9565b15f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZJHwrpA {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZJHwrpA" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c8218-94e7-435a-add6-da185c44c03c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZJHwrpA'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[496df1ec-1a0c-4908-a320-46e2f73f88b5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21f5ba-d48a-4378-be16-9a225582124f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8332e0-2995-4ed7-b451-90587c801f43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260]
Aug 16 20:06:43 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260] successful.
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f27a6-0f63-420d-b14d-01ba2f1c17f8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-72068577-20b0-47c1-8c5d-4a847e4b6f7f req-09ed9164-1a17-4912-b3e6-45f1e6ebcd7e service nova] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Received event network-vif-deleted-5c4317ba-fb95-423b-bf5c-94cfd816ffd0 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc0cfc9-d190-4336-953a-f66089b5c489]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:06:43 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:06:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3afc91-001f-475c-82e0-e85018a3842a]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:06:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZJHwrpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:06:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26462656434616536', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462656434616536', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929888821',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7mFn0LcVbWpuX1GVAHCAfJn2BkbWDm8cUL/VEhYSFDFzlKR60tA3i7gZmj0/D8lHdipPXA3g2yZM3pzBmzkH2bYKiJ+20Mx03/YjRca1gzqmrnrYmQgMRkRDgwENF2Ig==',key_name='tempest-keypair-2071324434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-sg0l0pfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=67838895-188d-42ea-9197-a9d8dc841ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid 67838895-188d-42ea-9197-a9d8dc841ae5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:06:45 user nova-compute[72894]:   <uuid>67838895-188d-42ea-9197-a9d8dc841ae5</uuid>
Aug 16 20:06:45 user nova-compute[72894]:   <name>instance-00000016</name>
Aug 16 20:06:45 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:06:45 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:06:45 user nova-compute[72894]:   <metadata>
Aug 16 20:06:45 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:06:45 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:06:45 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1929888821</nova:name>
Aug 16 20:06:45 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:06:43</nova:creationTime>
Aug 16 20:06:45 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:06:45 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:06:45 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:06:45 user nova-compute[72894]:       <nova:owner>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:06:45 user nova-compute[72894]:       </nova:owner>
Aug 16 20:06:45 user nova-compute[72894]:       <nova:ports>
Aug 16 20:06:45 user nova-compute[72894]:         <nova:port uuid="b6f99dea-3695-4b5b-a3b1-52a58e4e4741">
Aug 16 20:06:45 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:06:45 user nova-compute[72894]:         </nova:port>
Aug 16 20:06:45 user nova-compute[72894]:       </nova:ports>
Aug 16 20:06:45 user nova-compute[72894]:     </nova:instance>
Aug 16 20:06:45 user nova-compute[72894]:   </metadata>
Aug 16 20:06:45 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:06:45 user nova-compute[72894]:     <system>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="serial">67838895-188d-42ea-9197-a9d8dc841ae5</entry>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="uuid">67838895-188d-42ea-9197-a9d8dc841ae5</entry>
Aug 16 20:06:45 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:06:45 user nova-compute[72894]:     </system>
Aug 16 20:06:45 user nova-compute[72894]:   </sysinfo>
Aug 16 20:06:45 user nova-compute[72894]:   <os>
Aug 16 20:06:45 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:06:45 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:06:45 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:06:45 user nova-compute[72894]:   </os>
Aug 16 20:06:45 user nova-compute[72894]:   <features>
Aug 16 20:06:45 user nova-compute[72894]:     <acpi/>
Aug 16 20:06:45 user nova-compute[72894]:     <apic/>
Aug 16 20:06:45 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:06:45 user nova-compute[72894]:   </features>
Aug 16 20:06:45 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:06:45 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:06:45 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:06:45 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:06:45 user nova-compute[72894]:   </clock>
Aug 16 20:06:45 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:06:45 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:06:45 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:06:45 user nova-compute[72894]:   </cpu>
Aug 16 20:06:45 user nova-compute[72894]:   <devices>
Aug 16 20:06:45 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:06:45 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:06:45 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:06:45 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:06:45 user nova-compute[72894]:       <serial>c4b66c2b-4ec6-40d5-9aba-827d0e43e562</serial>
Aug 16 20:06:45 user nova-compute[72894]:     </disk>
Aug 16 20:06:45 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:06:45 user nova-compute[72894]:       <mac address="fa:16:3e:dd:f7:39"/>
Aug 16 20:06:45 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:06:45 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:06:45 user nova-compute[72894]:       <target dev="tapb6f99dea-36"/>
Aug 16 20:06:45 user nova-compute[72894]:     </interface>
Aug 16 20:06:45 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:06:45 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/67838895-188d-42ea-9197-a9d8dc841ae5/console.log" append="off"/>
Aug 16 20:06:45 user nova-compute[72894]:     </serial>
Aug 16 20:06:45 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:06:45 user nova-compute[72894]:     <video>
Aug 16 20:06:45 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:06:45 user nova-compute[72894]:     </video>
Aug 16 20:06:45 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:06:45 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:06:45 user nova-compute[72894]:     </rng>
Aug 16 20:06:45 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:06:45 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:06:45 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:06:45 user nova-compute[72894]:     </memballoon>
Aug 16 20:06:45 user nova-compute[72894]:   </devices>
Aug 16 20:06:45 user nova-compute[72894]: </domain>
Aug 16 20:06:45 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929888821',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7mFn0LcVbWpuX1GVAHCAfJn2BkbWDm8cUL/VEhYSFDFzlKR60tA3i7gZmj0/D8lHdipPXA3g2yZM3pzBmzkH2bYKiJ+20Mx03/YjRca1gzqmrnrYmQgMRkRDgwENF2Ig==',key_name='tempest-keypair-2071324434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-sg0l0pfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=67838895-188d-42ea-9197-a9d8dc841ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG os_vif [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6f99dea-36, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6f99dea-36, col_values=(('external_ids', {'iface-id': 'b6f99dea-3695-4b5b-a3b1-52a58e4e4741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:f7:39', 'vm-uuid': '67838895-188d-42ea-9197-a9d8dc841ae5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:45 user nova-compute[72894]: INFO os_vif [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36')
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:06:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:dd:f7:39, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:46 user nova-compute[72894]: WARNING nova.compute.manager [req-f6d2347f-6a06-4778-9c67-bc7d4633c3db req-9e456162-f836-46da-84fb-20135a85540c service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state building and task_state spawning.
Aug 16 20:06:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Took 5.44 seconds to detach 1 volumes for instance.
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Deleting volume: 962748d6-0dd6-4d49-88af-0a5065fdb942 {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Deleted allocations for instance 58ff42d5-d55e-4d30-b71a-2c64b22b35a3
Aug 16 20:06:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:48 user nova-compute[72894]: WARNING nova.compute.manager [req-29298f28-49e3-4618-b430-aa69bdeff117 req-71e31763-9818-491a-b650-f4fe8b8f33a0 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state building and task_state spawning.
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216408.7803793, 67838895-188d-42ea-9197-a9d8dc841ae5 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] VM Resumed (Lifecycle Event)
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Instance spawned successfully.
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c816e4b-3129-4f63-9a29-e78b3bf3dc2c tempest-TestShelveInstance-1481575186 tempest-TestShelveInstance-1481575186-project-member] Lock "58ff42d5-d55e-4d30-b71a-2c64b22b35a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.510s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216408.785421, 67838895-188d-42ea-9197-a9d8dc841ae5 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] VM Started (Lifecycle Event)
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:06:48 user nova-compute[72894]: INFO nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 16 20:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:49 user nova-compute[72894]: INFO nova.compute.manager [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Took 19.36 seconds to build instance.
Aug 16 20:06:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b01485dc-1011-494d-82bf-9d767f5b045b tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.489s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216396.0544667, 12dd204d-9368-47c2-88e2-8d97ff942621 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:51 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] VM Stopped (Lifecycle Event)
Aug 16 20:06:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-472d5403-0651-40ae-a2ed-8729de301345 None None] [instance: 12dd204d-9368-47c2-88e2-8d97ff942621] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_requests' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'numa_topology' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:06:51 user nova-compute[72894]: INFO nova.compute.claims [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Claim successful on node user
Aug 16 20:06:52 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:06:52 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:06:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:52 user nova-compute[72894]: INFO nova.network.neutron [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating port 811bf633-15a4-4a39-8270-e8b54399cbed with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing instance network info cache due to event network-changed-811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:06:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] Acquiring lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:06:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Creating image(s)
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] Acquired lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG nova.network.neutron [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Refreshing network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "7e551d4e363ba833014226eb2c509fd8f46fd383" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "7e551d4e363ba833014226eb2c509fd8f46fd383" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.part --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG nova.virt.images [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] 5171f58a-3de2-4680-bac3-3907e52ae459 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.part /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG nova.network.neutron [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updated VIF entry in instance network info cache for port 811bf633-15a4-4a39-8270-e8b54399cbed. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG nova.network.neutron [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:06:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-164f8dc4-6780-4c8b-a0df-d1c90af85e8f req-34d3e430-12b5-43ee-8bf1-54167a8f43d4 service nova] Releasing lock "refresh_cache-2073e7a0-b213-44da-9249-47ace2f78b84" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216401.1380537, 58ff42d5-d55e-4d30-b71a-2c64b22b35a3 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:06:56 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] VM Stopped (Lifecycle Event)
Aug 16 20:06:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9e853426-0dd6-4d49-94d1-668d596cd5da None None] [instance: 58ff42d5-d55e-4d30-b71a-2c64b22b35a3] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.part /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.converted" returned: 0 in 0.647s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "7e551d4e363ba833014226eb2c509fd8f46fd383" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.155s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "7e551d4e363ba833014226eb2c509fd8f46fd383" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "7e551d4e363ba833014226eb2c509fd8f46fd383" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383,backing_fmt=raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383,backing_fmt=raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk 1073741824" returned: 0 in 0.051s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "7e551d4e363ba833014226eb2c509fd8f46fd383" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:57 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'migration_context' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:06:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Rebasing disk image.
Aug 16 20:06:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:06:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f -F raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:58 user nova-compute[72894]: INFO nova.compute.manager [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Terminating instance
Aug 16 20:06:58 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:06:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-unplugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] No waiting events found dispatching network-vif-unplugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:06:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-136abfb0-726b-4033-873f-5d7073b210dd req-1c9a8cba-3826-4717-81dc-6c15fd71c7ef service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-unplugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:07:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Instance destroyed successfully.
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lazy-loading 'resources' on Instance uuid 7b2c0761-d8f9-411b-8df7-9f79795029fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1834134842',display_name='tempest-TestVolumeSwap-server-1834134842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1834134842',id=16,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnA22GQypd5ohEWUDbaltdiUGAzD/EBDX4fxSADK4RYBm+4rS/N1pEGLsFwkdzrHp2J88S3bCat2C5sjwkR9bw31XkoXMdZ22uvfTKkyi/DoLM/jQm+oqewXom1cnfHAw==',key_name='tempest-keypair-1156483859',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbf0814c43b248be85d1a2db26870976',ramdisk_id='',reservation_id='r-knpm6s1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1153771719',owner_user_name='tempest-TestVolumeSwap-1153771719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bebd9cb0f85b44498beafbbb256b68be',uuid=7b2c0761-d8f9-411b-8df7-9f79795029fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converting VIF {"id": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "address": "fa:16:3e:bb:a8:8b", "network": {"id": "7a08c19b-df79-4055-9512-9c8c28ddcb53", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1148375086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf0814c43b248be85d1a2db26870976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7bc3c8-2a", "ovs_interfaceid": "df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_vif [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf7bc3c8-2a, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:00 user nova-compute[72894]: INFO os_vif [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:a8:8b,bridge_name='br-int',has_traffic_filtering=True,id=df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6,network=Network(7a08c19b-df79-4055-9512-9c8c28ddcb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7bc3c8-2a')
Aug 16 20:07:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Deleting instance files /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd_del
Aug 16 20:07:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Deletion of /opt/stack/data/nova/instances/7b2c0761-d8f9-411b-8df7-9f79795029fd_del complete
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f -F raw /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk" returned: 0 in 2.865s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Ensure instance console log exists: /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start _get_guest_xml network_info=[{"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='628534a160153a15e47306805c5327cf',container_format='bare',created_at=2023-08-16T20:04:45Z,direct_url=<?>,disk_format='qcow2',id=5171f58a-3de2-4680-bac3-3907e52ae459,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1228818073-shelved',owner='53a14259280244b3ad64ea5fb30ce7bf',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T20:04:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': 'c44c5148-aa7f-446e-843a-5edd6aeaf565', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgvxZuGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '2073e7a0-b213-44da-9249-47ace2f78b84', 'attached_at': '', 'detached_at': '', 'volume_id': '5a05fb1b-7e85-465d-8e7d-8aa42f7ab238', 'serial': '5a05fb1b-7e85-465d-8e7d-8aa42f7ab238'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:07:00 user nova-compute[72894]: INFO nova.compute.manager [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:07:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:07:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='628534a160153a15e47306805c5327cf',container_format='bare',created_at=2023-08-16T20:04:45Z,direct_url=<?>,disk_format='qcow2',id=5171f58a-3de2-4680-bac3-3907e52ae459,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1228818073-shelved',owner='53a14259280244b3ad64ea5fb30ce7bf',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T20:04:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgvxZuGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:07:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:07:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:07:00 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9aeae1-e2e1-4e48-84e4-02caa63eb195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:07:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d060817-bc48-4688-b390-ae4d647dd6ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238] added
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2b273-afc1-44b7-b57d-66b25c50705d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e72743-b2e2-4a23-af58-756bcf42970e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgvxZuGW {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgvxZuGW" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660e053-7bda-40b8-bc90-3df08669acd0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgvxZuGW'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71c528-7665-4649-86be-ddc124a75a45]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c5fc4-e41c-44eb-b50f-149054c0a5ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a081f92-9db9-43af-96c9-7dc0c56aa177]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260]
Aug 16 20:07:00 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260] successful.
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faf1976-1f99-4823-a277-932f8d9160b7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9badb-1962-4628-ac10-697ce2181aeb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b83982-0143-4b7d-9c54-c6dc2c37f490]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:07:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgvxZuGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] Acquiring lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] No waiting events found dispatching network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:01 user nova-compute[72894]: WARNING nova.compute.manager [req-1e5d535b-76f9-4135-a20d-348cb134842d req-025d1f4e-2536-4480-a152-f6b16170e1c8 service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received unexpected event network-vif-plugged-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 for instance with vm_state active and task_state deleting.
Aug 16 20:07:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23838626130383964', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838626130383964', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='5171f58a-3de2-4680-bac3-3907e52ae459',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-480767158',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:04:49.556247',shelved_host='user',shelved_image_id='5171f58a-3de2-4680-bac3-3907e52ae459'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_devices' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:01 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Took 1.53 seconds to deallocate network for instance.
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:07:01 user nova-compute[72894]:   <uuid>2073e7a0-b213-44da-9249-47ace2f78b84</uuid>
Aug 16 20:07:01 user nova-compute[72894]:   <name>instance-0000000f</name>
Aug 16 20:07:01 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:07:01 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:07:01 user nova-compute[72894]:   <metadata>
Aug 16 20:07:01 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:07:01 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1228818073</nova:name>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:07:00</nova:creationTime>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:07:01 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:07:01 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:owner>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:user uuid="387415e40279468eaf69c06b271be2c9">tempest-AttachVolumeShelveTestJSON-1527512383-project-member</nova:user>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:project uuid="53a14259280244b3ad64ea5fb30ce7bf">tempest-AttachVolumeShelveTestJSON-1527512383</nova:project>
Aug 16 20:07:01 user nova-compute[72894]:       </nova:owner>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:root type="image" uuid="5171f58a-3de2-4680-bac3-3907e52ae459"/>
Aug 16 20:07:01 user nova-compute[72894]:       <nova:ports>
Aug 16 20:07:01 user nova-compute[72894]:         <nova:port uuid="811bf633-15a4-4a39-8270-e8b54399cbed">
Aug 16 20:07:01 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:07:01 user nova-compute[72894]:         </nova:port>
Aug 16 20:07:01 user nova-compute[72894]:       </nova:ports>
Aug 16 20:07:01 user nova-compute[72894]:     </nova:instance>
Aug 16 20:07:01 user nova-compute[72894]:   </metadata>
Aug 16 20:07:01 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:07:01 user nova-compute[72894]:     <system>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="serial">2073e7a0-b213-44da-9249-47ace2f78b84</entry>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="uuid">2073e7a0-b213-44da-9249-47ace2f78b84</entry>
Aug 16 20:07:01 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:07:01 user nova-compute[72894]:     </system>
Aug 16 20:07:01 user nova-compute[72894]:   </sysinfo>
Aug 16 20:07:01 user nova-compute[72894]:   <os>
Aug 16 20:07:01 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:07:01 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:07:01 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:07:01 user nova-compute[72894]:   </os>
Aug 16 20:07:01 user nova-compute[72894]:   <features>
Aug 16 20:07:01 user nova-compute[72894]:     <acpi/>
Aug 16 20:07:01 user nova-compute[72894]:     <apic/>
Aug 16 20:07:01 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:07:01 user nova-compute[72894]:   </features>
Aug 16 20:07:01 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:07:01 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:07:01 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:07:01 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:07:01 user nova-compute[72894]:   </clock>
Aug 16 20:07:01 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:07:01 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:07:01 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:07:01 user nova-compute[72894]:   </cpu>
Aug 16 20:07:01 user nova-compute[72894]:   <devices>
Aug 16 20:07:01 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:07:01 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:07:01 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk"/>
Aug 16 20:07:01 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:07:01 user nova-compute[72894]:     </disk>
Aug 16 20:07:01 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:07:01 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:07:01 user nova-compute[72894]:       <source dev="/dev/sdd"/>
Aug 16 20:07:01 user nova-compute[72894]:       <target dev="vdc" bus="virtio"/>
Aug 16 20:07:01 user nova-compute[72894]:       <serial>5a05fb1b-7e85-465d-8e7d-8aa42f7ab238</serial>
Aug 16 20:07:01 user nova-compute[72894]:     </disk>
Aug 16 20:07:01 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:07:01 user nova-compute[72894]:       <mac address="fa:16:3e:c7:9a:b8"/>
Aug 16 20:07:01 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:07:01 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:07:01 user nova-compute[72894]:       <target dev="tap811bf633-15"/>
Aug 16 20:07:01 user nova-compute[72894]:     </interface>
Aug 16 20:07:01 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:07:01 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/console.log" append="off"/>
Aug 16 20:07:01 user nova-compute[72894]:     </serial>
Aug 16 20:07:01 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:07:01 user nova-compute[72894]:     <video>
Aug 16 20:07:01 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:07:01 user nova-compute[72894]:     </video>
Aug 16 20:07:01 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:07:01 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:07:01 user nova-compute[72894]:     </rng>
Aug 16 20:07:01 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:07:01 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:07:01 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:07:01 user nova-compute[72894]:     </memballoon>
Aug 16 20:07:01 user nova-compute[72894]:   </devices>
Aug 16 20:07:01 user nova-compute[72894]: </domain>
Aug 16 20:07:01 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='5171f58a-3de2-4680-bac3-3907e52ae459',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-480767158',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:04:49.556247',shelved_host='user',shelved_image_id='5171f58a-3de2-4680-bac3-3907e52ae459'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG os_vif [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap811bf633-15, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap811bf633-15, col_values=(('external_ids', {'iface-id': '811bf633-15a4-4a39-8270-e8b54399cbed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:9a:b8', 'vm-uuid': '2073e7a0-b213-44da-9249-47ace2f78b84'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:01 user nova-compute[72894]: INFO os_vif [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15')
Aug 16 20:07:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:07:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No VIF found with MAC fa:16:3e:c7:9a:b8, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:07:02 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:07:02 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:07:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:02 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Deleted allocations for instance 7b2c0761-d8f9-411b-8df7-9f79795029fd
Aug 16 20:07:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7c2516a-a050-46cb-892d-b93a93234a5b tempest-TestVolumeSwap-1153771719 tempest-TestVolumeSwap-1153771719-project-member] Lock "7b2c0761-d8f9-411b-8df7-9f79795029fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.664s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d4c9be1-ce6c-4835-90a4-7f83e9746b7c req-34cb40f5-a59b-4920-9e71-6ffb1085133a service nova] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Received event network-vif-deleted-df7bc3c8-2aad-4a92-b41f-7bd84e0f67b6 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:05 user nova-compute[72894]: WARNING nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:05 user nova-compute[72894]: WARNING nova.compute.manager [req-d1e68e79-075f-4fc0-be76-0049a1bf6ff7 req-54c8b925-f5eb-4c39-b5af-36c83f9edb8e service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216425.7669592, 2073e7a0-b213-44da-9249-47ace2f78b84 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:07:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Resumed (Lifecycle Event)
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:07:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance spawned successfully.
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:07:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216425.7679043, 2073e7a0-b213-44da-9249-47ace2f78b84 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:07:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Started (Lifecycle Event)
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:07:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:07:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0ca0f0a2-bf2a-452b-86ad-6328e032708e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.124s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:09 user nova-compute[72894]: INFO nova.compute.manager [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Detaching volume 0d2a3667-74ed-480c-a16f-1187f95ea0dc
Aug 16 20:07:09 user nova-compute[72894]: INFO nova.virt.block_device [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Attempting to driver detach volume 0d2a3667-74ed-480c-a16f-1187f95ea0dc from mountpoint /dev/vdb
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Attempting to detach device vdb from instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:07:09 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:07:09 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:07:09 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:07:09 user nova-compute[72894]:   <serial>0d2a3667-74ed-480c-a16f-1187f95ea0dc</serial>
Aug 16 20:07:09 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:07:09 user nova-compute[72894]: </disk>
Aug 16 20:07:09 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:07:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully detached device vdb from instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 from the persistent domain config.
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:07:09 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:07:09 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:07:09 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:07:09 user nova-compute[72894]:   <serial>0d2a3667-74ed-480c-a16f-1187f95ea0dc</serial>
Aug 16 20:07:09 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:07:09 user nova-compute[72894]: </disk>
Aug 16 20:07:09 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216429.8657446, 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:07:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully detached device vdb from instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 from the live domain config.
Aug 16 20:07:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIUXhPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:07:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdf23c-ef90-44d7-8e88-fcaf2d677275]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153c6ca-46a3-4ac0-8df5-8cef95b697af]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:09 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990486290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:07:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.132s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff8b0e-5f1f-4db2-b6d3-7cf8672144b6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41bdf17-720f-46fc-b12d-220df6d36f9d]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce64c71-547c-4c77-9eab-d77473227393]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca667c8-c069-4907-8668-d1a52d2288d0]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f974bb8-481e-43fd-8f48-1a4043a413d0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16c4fc-d5ce-4ba9-90be-ac92732a7934]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260]
Aug 16 20:07:10 user nova-compute[72894]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc, portal: 172.16.0.220,3260] successful.
Aug 16 20:07:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e209e-fd62-4e1e-bc44-2944eff0720e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== disconnect_volume: return (422ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:07:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d5300952-17e7-4b63-976f-0dbd552d66a5 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.997s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.815s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:11 user nova-compute[72894]: INFO nova.compute.manager [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Terminating instance
Aug 16 20:07:11 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-unplugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] No waiting events found dispatching network-vif-unplugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0b8a6749-cf86-4162-876b-4d746e93527c req-031c5ad6-20e1-4410-ae1a-18e828f82261 service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-unplugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:07:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Instance destroyed successfully.
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'resources' on Instance uuid 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484187802',display_name='tempest-VolumesSnapshotTestJSON-instance-1484187802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484187802',id=20,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgalm70Am1Z7HJ6oLjpp5BlMLqeYpfwEbqg04asyr9hgLiW+iFQLqTHDdOv92J08BCx+KlKnQiMFy0tnM04TyHIaluoPXRoBrlZvxjaM9bLgzCAL8UxRT6OnimI8IikJQ==',key_name='tempest-keypair-1282873152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-4mqi7m0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "address": "fa:16:3e:7a:78:01", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b34f9e-63", "ovs_interfaceid": "20b34f9e-63d4-4f5d-b351-0250ca442c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_vif [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20b34f9e-63, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:12 user nova-compute[72894]: INFO os_vif [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:78:01,bridge_name='br-int',has_traffic_filtering=True,id=20b34f9e-63d4-4f5d-b351-0250ca442c21,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b34f9e-63')
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIUXhPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:07:12 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a3667-74ed-480c-a16f-1187f95ea0dc', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe9349-bcbf-46c8-8607-e921f148a7b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7310209-e838-4b93-b814-95f5f407691c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:07:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990455b40>, {}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Disconnecting from: [] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== disconnect_volume: return (50ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:07:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Deleting instance files /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959_del
Aug 16 20:07:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Deletion of /opt/stack/data/nova/instances/6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959_del complete
Aug 16 20:07:12 user nova-compute[72894]: INFO nova.compute.manager [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 20:07:12 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:07:12 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:07:13 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Took 1.10 seconds to deallocate network for instance.
Aug 16 20:07:13 user nova-compute[72894]: WARNING nova.volume.cinder [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Attachment 9d2ea641-1acf-45ac-9e0c-6e770a5fe08c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9d2ea641-1acf-45ac-9e0c-6e770a5fe08c. (HTTP 404) (Request-ID: req-3b4f822b-b070-4750-a62a-bce3800c4c34)
Aug 16 20:07:13 user nova-compute[72894]: INFO nova.compute.manager [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] Acquiring lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] No waiting events found dispatching network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:13 user nova-compute[72894]: WARNING nova.compute.manager [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received unexpected event network-vif-plugged-20b34f9e-63d4-4f5d-b351-0250ca442c21 for instance with vm_state deleted and task_state None.
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0ac3a7f-8d56-4568-b570-4becd263a521 req-1d67dea2-6075-4588-b3d1-df9b977a11ee service nova] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Received event network-vif-deleted-20b34f9e-63d4-4f5d-b351-0250ca442c21 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:13 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Deleted allocations for instance 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959
Aug 16 20:07:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9e389cb8-e13d-40ed-826e-8ef549d6e3c2 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.716s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:14 user nova-compute[72894]: INFO nova.compute.manager [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Terminating instance
Aug 16 20:07:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-e86b60f9-994b-455d-ad81-b3fac15294d1 req-2930123f-5415-4475-90a3-c1b5892c5f73 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-unplugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216420.0120845, 7b2c0761-d8f9-411b-8df7-9f79795029fd => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:07:15 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] VM Stopped (Lifecycle Event)
Aug 16 20:07:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f0ae129b-d77c-4d00-bd43-df550a1abe4a None None] [instance: 7b2c0761-d8f9-411b-8df7-9f79795029fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Instance destroyed successfully.
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'resources' on Instance uuid ff3a42d6-469e-4194-be6d-eacc72cc87fd {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1567234370',display_name='tempest-ServerActionsTestOtherA-server-1906060169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1567234370',id=12,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXcEuBC+5j/0lyfiGyZvGwwvugPsnq+R5quWT9kfU4y+PUT/EE2g0OYYXDMHAXLRs3qZbhqiQTawOhglT9xJloGnRgqfF8IMajsnvsuSu0vazbs2jSqAtLYwYHPKr3iJg==',key_name='tempest-keypair-664801602',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-reruo1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=ff3a42d6-469e-4194-be6d-eacc72cc87fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "95d8940b-470c-4483-844f-a4f46d7059c5", "address": "fa:16:3e:cd:76:ff", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8940b-47", "ovs_interfaceid": "95d8940b-470c-4483-844f-a4f46d7059c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG os_vif [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95d8940b-47, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:15 user nova-compute[72894]: INFO os_vif [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:76:ff,bridge_name='br-int',has_traffic_filtering=True,id=95d8940b-470c-4483-844f-a4f46d7059c5,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8940b-47')
Aug 16 20:07:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Deleting instance files /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd_del
Aug 16 20:07:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Deletion of /opt/stack/data/nova/instances/ff3a42d6-469e-4194-be6d-eacc72cc87fd_del complete
Aug 16 20:07:15 user nova-compute[72894]: INFO nova.compute.manager [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 20:07:15 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:07:15 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:07:16 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Took 0.96 seconds to deallocate network for instance.
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-26d9de34-9b09-4c80-9b6e-db82d0e5d0e3 req-fcf70653-7498-415b-bdc4-2886b89d8dd7 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-deleted-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] Acquiring lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] No waiting events found dispatching network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:07:16 user nova-compute[72894]: WARNING nova.compute.manager [req-c21f9054-a5c4-4738-832e-478544b1f7b4 req-290299af-4e2a-4a86-9361-2f63a07361c7 service nova] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Received unexpected event network-vif-plugged-95d8940b-470c-4483-844f-a4f46d7059c5 for instance with vm_state deleted and task_state None.
Aug 16 20:07:16 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Deleted allocations for instance ff3a42d6-469e-4194-be6d-eacc72cc87fd
Aug 16 20:07:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b4cffc85-cc80-43cf-be56-99b7ad09d41d tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "ff3a42d6-469e-4194-be6d-eacc72cc87fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:27 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216432.047331, 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:07:27 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] VM Stopped (Lifecycle Event)
Aug 16 20:07:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a22e61c5-637f-47d8-a1a9-a05b9712ee58 None None] [instance: 6ed0e37b-baf5-4bb6-9a3e-2f4c80b88959] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:30 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216435.0679667, ff3a42d6-469e-4194-be6d-eacc72cc87fd => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:07:30 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] VM Stopped (Lifecycle Event)
Aug 16 20:07:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9f0728ce-a6cc-4ab7-adfc-242495ec3490 None None] [instance: ff3a42d6-469e-4194-be6d-eacc72cc87fd] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:07:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:07:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7528MB free_disk=24.444446563720703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 67838895-188d-42ea-9197-a9d8dc841ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 2073e7a0-b213-44da-9249-47ace2f78b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:07:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:07:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:07:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:07:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:07:55 user nova-compute[72894]: INFO nova.compute.manager [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] instance snapshotting
Aug 16 20:07:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Beginning live snapshot process
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.248s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a.delta 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a.delta 1073741824" returned: 0 in 0.061s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 20:07:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:07:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:07:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 20:07:58 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:07:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a.delta /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:07:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a.delta /opt/stack/data/nova/instances/snapshots/tmp6w6mtvj0/5e9a80a2b1654d52befcaa6d5142f69a" returned: 0 in 0.581s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:07:59 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Snapshot extracted, beginning image upload
Aug 16 20:08:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:01 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Snapshot image upload complete
Aug 16 20:08:01 user nova-compute[72894]: INFO nova.compute.manager [None req-433dc0ce-46cf-4fa2-87b7-16aece16e9fb tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Took 5.92 seconds to snapshot the instance on the hypervisor.
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:08:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:18 user nova-compute[72894]: INFO nova.compute.manager [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Rescuing
Aug 16 20:08:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:08:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:19 user nova-compute[72894]: WARNING nova.compute.manager [req-45a5cc16-e04c-436f-925b-73f4b28eadc5 req-c1d828d1-3012-4a45-bcbd-ca105e440839 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state active and task_state rescuing.
Aug 16 20:08:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance destroyed successfully.
Aug 16 20:08:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Attempting rescue
Aug 16 20:08:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:08:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Creating image(s)
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start _get_guest_xml network_info=[{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:65:ca:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '60545238-42c7-459f-80c0-4238accb7183', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'numa_topology' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1176160800',display_name='tempest-ServerRescueNegativeTestJSON-server-1176160800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1176160800',id=18,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-1jnbdiq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:03:42Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=60dd6c6f-825a-4367-a215-c3989d1db134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:65:ca:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:65:ca:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:08:20 user nova-compute[72894]:   <uuid>60dd6c6f-825a-4367-a215-c3989d1db134</uuid>
Aug 16 20:08:20 user nova-compute[72894]:   <name>instance-00000012</name>
Aug 16 20:08:20 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:08:20 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:08:20 user nova-compute[72894]:   <metadata>
Aug 16 20:08:20 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:08:20 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1176160800</nova:name>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:08:20</nova:creationTime>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:08:20 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:08:20 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:owner>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:08:20 user nova-compute[72894]:       </nova:owner>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:08:20 user nova-compute[72894]:       <nova:ports>
Aug 16 20:08:20 user nova-compute[72894]:         <nova:port uuid="05779040-3363-4917-a20c-c2971d311404">
Aug 16 20:08:20 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 20:08:20 user nova-compute[72894]:         </nova:port>
Aug 16 20:08:20 user nova-compute[72894]:       </nova:ports>
Aug 16 20:08:20 user nova-compute[72894]:     </nova:instance>
Aug 16 20:08:20 user nova-compute[72894]:   </metadata>
Aug 16 20:08:20 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:08:20 user nova-compute[72894]:     <system>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="serial">60dd6c6f-825a-4367-a215-c3989d1db134</entry>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="uuid">60dd6c6f-825a-4367-a215-c3989d1db134</entry>
Aug 16 20:08:20 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:08:20 user nova-compute[72894]:     </system>
Aug 16 20:08:20 user nova-compute[72894]:   </sysinfo>
Aug 16 20:08:20 user nova-compute[72894]:   <os>
Aug 16 20:08:20 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:08:20 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:08:20 user nova-compute[72894]:   </os>
Aug 16 20:08:20 user nova-compute[72894]:   <features>
Aug 16 20:08:20 user nova-compute[72894]:     <acpi/>
Aug 16 20:08:20 user nova-compute[72894]:     <apic/>
Aug 16 20:08:20 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:08:20 user nova-compute[72894]:   </features>
Aug 16 20:08:20 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:08:20 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:08:20 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:08:20 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:08:20 user nova-compute[72894]:   </clock>
Aug 16 20:08:20 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:08:20 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:08:20 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:08:20 user nova-compute[72894]:   </cpu>
Aug 16 20:08:20 user nova-compute[72894]:   <devices>
Aug 16 20:08:20 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:08:20 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:08:20 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue"/>
Aug 16 20:08:20 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:08:20 user nova-compute[72894]:     </disk>
Aug 16 20:08:20 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:08:20 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:08:20 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk"/>
Aug 16 20:08:20 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:08:20 user nova-compute[72894]:     </disk>
Aug 16 20:08:20 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:08:20 user nova-compute[72894]:       <mac address="fa:16:3e:65:ca:1e"/>
Aug 16 20:08:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:20 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:08:20 user nova-compute[72894]:       <target dev="tap05779040-33"/>
Aug 16 20:08:20 user nova-compute[72894]:     </interface>
Aug 16 20:08:20 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:08:20 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/console.log" append="off"/>
Aug 16 20:08:20 user nova-compute[72894]:     </serial>
Aug 16 20:08:20 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:08:20 user nova-compute[72894]:     <video>
Aug 16 20:08:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:20 user nova-compute[72894]:     </video>
Aug 16 20:08:20 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:08:20 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:08:20 user nova-compute[72894]:     </rng>
Aug 16 20:08:20 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:08:20 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:08:20 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:08:20 user nova-compute[72894]:     </memballoon>
Aug 16 20:08:20 user nova-compute[72894]:   </devices>
Aug 16 20:08:20 user nova-compute[72894]: </domain>
Aug 16 20:08:20 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:08:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance destroyed successfully.
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:08:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:65:ca:1e, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:21 user nova-compute[72894]: WARNING nova.compute.manager [req-ef7b6bec-4aec-4204-b628-a66d911d5a9e req-14d23de3-f795-4a6b-bc0f-16b52b347bc0 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state active and task_state rescuing.
Aug 16 20:08:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-changed-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Refreshing instance network info cache due to event network-changed-b6f99dea-3695-4b5b-a3b1-52a58e4e4741. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] Acquiring lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] Acquired lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Refreshing network info cache for port b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updated VIF entry in instance network info cache for port b6f99dea-3695-4b5b-a3b1-52a58e4e4741. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updating instance_info_cache with network_info: [{"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:23 user nova-compute[72894]: WARNING nova.compute.manager [req-e28b397f-fa00-4310-84b9-0dfa9abc97a1 req-370a1a2a-cb91-440b-824a-d4d8a42de272 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state active and task_state rescuing.
Aug 16 20:08:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7db246a0-5251-4e57-9ae1-532c9ceb8525 req-dc0bc616-e0a5-48f1-8eaf-250060e17222 service nova] Releasing lock "refresh_cache-67838895-188d-42ea-9197-a9d8dc841ae5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 60dd6c6f-825a-4367-a215-c3989d1db134 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216504.4209146, 60dd6c6f-825a-4367-a215-c3989d1db134 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Resumed (Lifecycle Event)
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-af59d9b8-6bc1-4a35-ac82-b3c2416376bc tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216504.426087, 60dd6c6f-825a-4367-a215-c3989d1db134 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Started (Lifecycle Event)
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:25 user nova-compute[72894]: WARNING nova.compute.manager [req-e7a66f0a-570a-4594-866c-12076bdc2ac5 req-69765190-732c-4aec-9cc2-bdb20128d2d3 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state rescued and task_state None.
Aug 16 20:08:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:29 user nova-compute[72894]: INFO nova.compute.manager [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Detaching volume 5a05fb1b-7e85-465d-8e7d-8aa42f7ab238
Aug 16 20:08:29 user nova-compute[72894]: INFO nova.virt.block_device [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Attempting to driver detach volume 5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 from mountpoint /dev/vdc
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Attempting to detach device vdc from instance 2073e7a0-b213-44da-9249-47ace2f78b84 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:08:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:08:29 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:08:29 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:08:29 user nova-compute[72894]:   <serial>5a05fb1b-7e85-465d-8e7d-8aa42f7ab238</serial>
Aug 16 20:08:29 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:08:29 user nova-compute[72894]: </disk>
Aug 16 20:08:29 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:08:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully detached device vdc from instance 2073e7a0-b213-44da-9249-47ace2f78b84 from the persistent domain config.
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2073e7a0-b213-44da-9249-47ace2f78b84 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:08:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:08:29 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:08:29 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:08:29 user nova-compute[72894]:   <serial>5a05fb1b-7e85-465d-8e7d-8aa42f7ab238</serial>
Aug 16 20:08:29 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:08:29 user nova-compute[72894]: </disk>
Aug 16 20:08:29 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216509.960095, 2073e7a0-b213-44da-9249-47ace2f78b84 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:08:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully detached device vdc from instance 2073e7a0-b213-44da-9249-47ace2f78b84 from the live domain config.
Aug 16 20:08:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgvxZuGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:08:29 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:08:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:08:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89b938-9378-40bb-be65-0706dba66925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4108900e-8b02-4561-86e8-70aea0beee8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 (non-flash)
Aug 16 20:08:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79981771c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81bf76-6826-4882-a20b-33171ecf77db]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3d920-b67f-48c1-96bb-7f9fb396ebf5]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453f37b-4b96-42ca-afa8-4fa556751bc6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db2955-759c-4e89-b981-37a845783daa]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[335db5b8-7729-4253-84d6-7c8d685ae0ce]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b8137d-bbba-4a25-a700-45fd77dae6fa]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260]
Aug 16 20:08:30 user nova-compute[72894]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238, portal: 172.16.0.220,3260] successful.
Aug 16 20:08:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a05fb1b-7e85-465d-8e7d-8aa42f7ab238 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1014a6-3437-40ae-8372-f202657766e3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] <== disconnect_volume: return (355ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:08:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:08:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'flavor' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1ee291fe-909c-495d-9917-b8b913fa50ef tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.808s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:08:37 user nova-compute[72894]: INFO nova.compute.claims [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Claim successful on node user
Aug 16 20:08:37 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:08:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:08:38 user nova-compute[72894]: INFO nova.virt.block_device [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Booting with volume snapshot 8ccbfb8a-1492-4b51-a6bf-c0369200871b at /dev/vda
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.policy [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Skipping network cache update for instance because it is Building. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:08:38 user nova-compute[72894]: INFO nova.compute.claims [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Claim successful on node user
Aug 16 20:08:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.018s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:08:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Successfully created port: 2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.policy [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7b74284f2c24d79bc01434de253ae70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564438a58fc64bf2b60d95f4c3eb0fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:08:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Creating image(s)
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "/opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "/opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "/opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:08:39 user nova-compute[72894]: INFO nova.compute.claims [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Claim successful on node user
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.270s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.273s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk 1073741824" returned: 0 in 0.064s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json" returned: 0 in 0.310s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Successfully created port: ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Cannot resize image /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'migration_context' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Successfully updated port: 2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Ensure instance console log exists: /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.976s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-changed-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Refreshing instance network info cache due to event network-changed-2904ccc4-2d12-4a35-8f81-84fb7fe7e769. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] Acquiring lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:08:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:08:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:08:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Creating image(s)
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "/opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "/opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "/opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.policy [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c230d020ad34a1588a93fd4a010750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b407241100354a8a97202de4aae0e75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updating instance_info_cache with network_info: [{"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Successfully updated port: ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Instance network_info: |[{"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] Acquired lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Refreshing network info cache for port 2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk 1073741824" returned: 0 in 0.057s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquired lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-changed-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Refreshing instance network info cache due to event network-changed-ee56abab-abe8-485f-a994-e4922696e53e. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] Acquiring lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Cannot resize image /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'migration_context' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Ensure instance console log exists: /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updated VIF entry in instance network info cache for port 2904ccc4-2d12-4a35-8f81-84fb7fe7e769. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updating instance_info_cache with network_info: [{"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5faf8e80-7a7c-4963-af69-0a7b8315676f req-600d8158-7b88-40b9-9d30-c7b48fc2cc85 service nova] Releasing lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Successfully created port: 6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updating instance_info_cache with network_info: [{"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Releasing lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Instance network_info: |[{"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] Acquired lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Refreshing network info cache for port ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Start _get_guest_xml network_info=[{"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:08:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-63241174',display_name='tempest-VolumesAdminNegativeTest-server-63241174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-63241174',id=24,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTnH/uqkMIIqdhx3/UuDr1+xAF7LIVbDoVP02LdjUVk8ySE8hOfysatmcDSprV8QaMj5tj+PkqutKmw98JLB9oZDPio+R6MSpoyKF7It/pNcu6OmBWBcZOarg0svNwZiA==',key_name='tempest-keypair-791501675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-1ugq4x0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7b74284f2c24d79bc01434de253ae70',uuid=eee52fdd-dc11-4f58-9e51-483a6a771403,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'pci_devices' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:08:42 user nova-compute[72894]:   <uuid>eee52fdd-dc11-4f58-9e51-483a6a771403</uuid>
Aug 16 20:08:42 user nova-compute[72894]:   <name>instance-00000018</name>
Aug 16 20:08:42 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:08:42 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:08:42 user nova-compute[72894]:   <metadata>
Aug 16 20:08:42 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:08:42 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:name>tempest-VolumesAdminNegativeTest-server-63241174</nova:name>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:08:42</nova:creationTime>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:08:42 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:08:42 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:owner>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:user uuid="d7b74284f2c24d79bc01434de253ae70">tempest-VolumesAdminNegativeTest-1980072019-project-member</nova:user>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:project uuid="564438a58fc64bf2b60d95f4c3eb0fe8">tempest-VolumesAdminNegativeTest-1980072019</nova:project>
Aug 16 20:08:42 user nova-compute[72894]:       </nova:owner>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:08:42 user nova-compute[72894]:       <nova:ports>
Aug 16 20:08:42 user nova-compute[72894]:         <nova:port uuid="ee56abab-abe8-485f-a994-e4922696e53e">
Aug 16 20:08:42 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:08:42 user nova-compute[72894]:         </nova:port>
Aug 16 20:08:42 user nova-compute[72894]:       </nova:ports>
Aug 16 20:08:42 user nova-compute[72894]:     </nova:instance>
Aug 16 20:08:42 user nova-compute[72894]:   </metadata>
Aug 16 20:08:42 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:08:42 user nova-compute[72894]:     <system>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="serial">eee52fdd-dc11-4f58-9e51-483a6a771403</entry>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="uuid">eee52fdd-dc11-4f58-9e51-483a6a771403</entry>
Aug 16 20:08:42 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:08:42 user nova-compute[72894]:     </system>
Aug 16 20:08:42 user nova-compute[72894]:   </sysinfo>
Aug 16 20:08:42 user nova-compute[72894]:   <os>
Aug 16 20:08:42 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:08:42 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:08:42 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:08:42 user nova-compute[72894]:   </os>
Aug 16 20:08:42 user nova-compute[72894]:   <features>
Aug 16 20:08:42 user nova-compute[72894]:     <acpi/>
Aug 16 20:08:42 user nova-compute[72894]:     <apic/>
Aug 16 20:08:42 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:08:42 user nova-compute[72894]:   </features>
Aug 16 20:08:42 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:08:42 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:08:42 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:08:42 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:08:42 user nova-compute[72894]:   </clock>
Aug 16 20:08:42 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:08:42 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:08:42 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:08:42 user nova-compute[72894]:   </cpu>
Aug 16 20:08:42 user nova-compute[72894]:   <devices>
Aug 16 20:08:42 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:08:42 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:08:42 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk"/>
Aug 16 20:08:42 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:08:42 user nova-compute[72894]:     </disk>
Aug 16 20:08:42 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:08:42 user nova-compute[72894]:       <mac address="fa:16:3e:7e:e2:cb"/>
Aug 16 20:08:42 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:42 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:08:42 user nova-compute[72894]:       <target dev="tapee56abab-ab"/>
Aug 16 20:08:42 user nova-compute[72894]:     </interface>
Aug 16 20:08:42 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:08:42 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/console.log" append="off"/>
Aug 16 20:08:42 user nova-compute[72894]:     </serial>
Aug 16 20:08:42 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:08:42 user nova-compute[72894]:     <video>
Aug 16 20:08:42 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:42 user nova-compute[72894]:     </video>
Aug 16 20:08:42 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:08:42 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:08:42 user nova-compute[72894]:     </rng>
Aug 16 20:08:42 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:08:42 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:08:42 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:08:42 user nova-compute[72894]:     </memballoon>
Aug 16 20:08:42 user nova-compute[72894]:   </devices>
Aug 16 20:08:42 user nova-compute[72894]: </domain>
Aug 16 20:08:42 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-63241174',display_name='tempest-VolumesAdminNegativeTest-server-63241174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-63241174',id=24,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTnH/uqkMIIqdhx3/UuDr1+xAF7LIVbDoVP02LdjUVk8ySE8hOfysatmcDSprV8QaMj5tj+PkqutKmw98JLB9oZDPio+R6MSpoyKF7It/pNcu6OmBWBcZOarg0svNwZiA==',key_name='tempest-keypair-791501675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-1ugq4x0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7b74284f2c24d79bc01434de253ae70',uuid=eee52fdd-dc11-4f58-9e51-483a6a771403,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG os_vif [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee56abab-ab, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee56abab-ab, col_values=(('external_ids', {'iface-id': 'ee56abab-abe8-485f-a994-e4922696e53e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e2:cb', 'vm-uuid': 'eee52fdd-dc11-4f58-9e51-483a6a771403'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:42 user nova-compute[72894]: INFO os_vif [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab')
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No VIF found with MAC fa:16:3e:7e:e2:cb, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216526.4313152, eee52fdd-dc11-4f58-9e51-483a6a771403 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:46 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] VM Resumed (Lifecycle Event)
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Successfully updated port: 6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-changed-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Refreshing instance network info cache due to event network-changed-6239d484-f4a5-45cc-8ebf-19d2291c1bcf. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] Acquiring lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] Acquired lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Refreshing network info cache for port 6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] No waiting events found dispatching network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:46 user nova-compute[72894]: WARNING nova.compute.manager [req-ca330394-95f6-4294-b436-41dabdfad7c4 req-701add30-2fa6-47d9-af12-65e6ad70f8d2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received unexpected event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e for instance with vm_state building and task_state spawning.
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] No waiting events found dispatching network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:46 user nova-compute[72894]: WARNING nova.compute.manager [req-037ee854-4c5a-4c49-aeff-9a4cbdfc04c9 req-e043030a-6f7b-45ae-a5e0-4ff4d8c78250 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received unexpected event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e for instance with vm_state building and task_state spawning.
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:46 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:46 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=24.37990951538086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:46 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Instance spawned successfully.
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:08:46 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216526.4338963, eee52fdd-dc11-4f58-9e51-483a6a771403 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:46 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] VM Started (Lifecycle Event)
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updated VIF entry in instance network info cache for port ee56abab-abe8-485f-a994-e4922696e53e. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:08:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updating instance_info_cache with network_info: [{"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0b4e0a60-4a8d-4b71-befd-a82315139706 req-60948689-375f-45ee-8faf-1d99737396cf service nova] Releasing lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:47 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 67838895-188d-42ea-9197-a9d8dc841ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 2073e7a0-b213-44da-9249-47ace2f78b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ffba17c7-da25-4759-9181-5a8732e7438d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e58319ae-a089-4b57-ad1b-922763b58293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:08:47 user nova-compute[72894]: INFO nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Took 7.60 seconds to spawn the instance on the hypervisor.
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.utils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[14efc414-dd17-497d-994a-f01d3d674c99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5ccce-dbc1-4259-a458-6640f5c9b583]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[987a0ec1-c38d-43b9-8aac-10f7990d476b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:47 user nova-compute[72894]: INFO nova.compute.manager [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Took 8.83 seconds to build instance.
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e387ab2-f29f-4ced-95de-0b39ce7dc898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a790f82b-bce3-497d-bb20-2e38c59fd780 req-3801dd12-5499-433a-855e-071ff8a2b7db service nova] Releasing lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9b331098-9085-4837-8ec7-a05654bcbd74 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.993s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquired lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:08:47 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c8eee-5dec-4467-9887-87d7e8feaf69]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG os_brick.utils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updating existing volume attachment record: 9bd0cbde-8bdb-4e4a-a87c-efe880341489 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updating instance_info_cache with network_info: [{"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Releasing lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:08:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance network_info: |[{"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Start _get_guest_xml network_info=[{"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:08:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-573217987',display_name='tempest-VolumesSnapshotTestJSON-instance-573217987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-573217987',id=25,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUfeF5d4rJfh0mTvDkwuIACEiZAe8uHq5TCFV+Wo9xAnqRPVsEZETwNClb9PuFmE0qiq4MznpdlAw+BiUDHMjcmtCtG104l1CpoJygqg6rAH5Tt6txvzA7Dafb22s+Y3g==',key_name='tempest-keypair-448632896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-3flvb0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=e58319ae-a089-4b57-ad1b-922763b58293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'pci_devices' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:08:48 user nova-compute[72894]:   <uuid>e58319ae-a089-4b57-ad1b-922763b58293</uuid>
Aug 16 20:08:48 user nova-compute[72894]:   <name>instance-00000019</name>
Aug 16 20:08:48 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:08:48 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:08:48 user nova-compute[72894]:   <metadata>
Aug 16 20:08:48 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:08:48 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-573217987</nova:name>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:08:48</nova:creationTime>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:08:48 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:08:48 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:owner>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:user uuid="6c230d020ad34a1588a93fd4a010750c">tempest-VolumesSnapshotTestJSON-762102976-project-member</nova:user>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:project uuid="b407241100354a8a97202de4aae0e75c">tempest-VolumesSnapshotTestJSON-762102976</nova:project>
Aug 16 20:08:48 user nova-compute[72894]:       </nova:owner>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:08:48 user nova-compute[72894]:       <nova:ports>
Aug 16 20:08:48 user nova-compute[72894]:         <nova:port uuid="6239d484-f4a5-45cc-8ebf-19d2291c1bcf">
Aug 16 20:08:48 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 20:08:48 user nova-compute[72894]:         </nova:port>
Aug 16 20:08:48 user nova-compute[72894]:       </nova:ports>
Aug 16 20:08:48 user nova-compute[72894]:     </nova:instance>
Aug 16 20:08:48 user nova-compute[72894]:   </metadata>
Aug 16 20:08:48 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:08:48 user nova-compute[72894]:     <system>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="serial">e58319ae-a089-4b57-ad1b-922763b58293</entry>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="uuid">e58319ae-a089-4b57-ad1b-922763b58293</entry>
Aug 16 20:08:48 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:08:48 user nova-compute[72894]:     </system>
Aug 16 20:08:48 user nova-compute[72894]:   </sysinfo>
Aug 16 20:08:48 user nova-compute[72894]:   <os>
Aug 16 20:08:48 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:08:48 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:08:48 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:08:48 user nova-compute[72894]:   </os>
Aug 16 20:08:48 user nova-compute[72894]:   <features>
Aug 16 20:08:48 user nova-compute[72894]:     <acpi/>
Aug 16 20:08:48 user nova-compute[72894]:     <apic/>
Aug 16 20:08:48 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:08:48 user nova-compute[72894]:   </features>
Aug 16 20:08:48 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:08:48 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:08:48 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:08:48 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:08:48 user nova-compute[72894]:   </clock>
Aug 16 20:08:48 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:08:48 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:08:48 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:08:48 user nova-compute[72894]:   </cpu>
Aug 16 20:08:48 user nova-compute[72894]:   <devices>
Aug 16 20:08:48 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:08:48 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:08:48 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk"/>
Aug 16 20:08:48 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:08:48 user nova-compute[72894]:     </disk>
Aug 16 20:08:48 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:08:48 user nova-compute[72894]:       <mac address="fa:16:3e:db:a3:2f"/>
Aug 16 20:08:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:48 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:08:48 user nova-compute[72894]:       <target dev="tap6239d484-f4"/>
Aug 16 20:08:48 user nova-compute[72894]:     </interface>
Aug 16 20:08:48 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:08:48 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/console.log" append="off"/>
Aug 16 20:08:48 user nova-compute[72894]:     </serial>
Aug 16 20:08:48 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:08:48 user nova-compute[72894]:     <video>
Aug 16 20:08:48 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:08:48 user nova-compute[72894]:     </video>
Aug 16 20:08:48 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:08:48 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:08:48 user nova-compute[72894]:     </rng>
Aug 16 20:08:48 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:08:48 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:08:48 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:08:48 user nova-compute[72894]:     </memballoon>
Aug 16 20:08:48 user nova-compute[72894]:   </devices>
Aug 16 20:08:48 user nova-compute[72894]: </domain>
Aug 16 20:08:48 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-573217987',display_name='tempest-VolumesSnapshotTestJSON-instance-573217987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-573217987',id=25,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUfeF5d4rJfh0mTvDkwuIACEiZAe8uHq5TCFV+Wo9xAnqRPVsEZETwNClb9PuFmE0qiq4MznpdlAw+BiUDHMjcmtCtG104l1CpoJygqg6rAH5Tt6txvzA7Dafb22s+Y3g==',key_name='tempest-keypair-448632896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-3flvb0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=e58319ae-a089-4b57-ad1b-922763b58293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG os_vif [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6239d484-f4, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6239d484-f4, col_values=(('external_ids', {'iface-id': '6239d484-f4a5-45cc-8ebf-19d2291c1bcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:a3:2f', 'vm-uuid': 'e58319ae-a089-4b57-ad1b-922763b58293'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:48 user nova-compute[72894]: INFO os_vif [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4')
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No VIF found with MAC fa:16:3e:db:a3:2f, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] No waiting events found dispatching network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:50 user nova-compute[72894]: WARNING nova.compute.manager [req-caae634f-cce7-43a6-a97f-226e82f7ef68 req-00b84801-f82c-4467-b1cc-7f07234f4b35 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received unexpected event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf for instance with vm_state building and task_state spawning.
Aug 16 20:08:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] No waiting events found dispatching network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:08:52 user nova-compute[72894]: WARNING nova.compute.manager [req-06f7e84c-de15-4a5d-81aa-7d64df148705 req-d55c9045-e5a4-4ca1-a21a-9d6b1ee2da2c service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received unexpected event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf for instance with vm_state building and task_state spawning.
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216532.1821942, e58319ae-a089-4b57-ad1b-922763b58293 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] VM Resumed (Lifecycle Event)
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance spawned successfully.
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216532.1870337, e58319ae-a089-4b57-ad1b-922763b58293 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] VM Started (Lifecycle Event)
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Took 11.27 seconds to spawn the instance on the hypervisor.
Aug 16 20:08:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:08:52 user nova-compute[72894]: INFO nova.compute.manager [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Took 12.75 seconds to build instance.
Aug 16 20:08:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7baabe9a-62ff-4dc7-815d-1e197cbad9fa tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.927s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:08:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:09:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Creating image(s)
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Ensure instance console log exists: /opt/stack/data/nova/instances/ffba17c7-da25-4759-9181-5a8732e7438d/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Start _get_guest_xml network_info=[{"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T20:08:24Z,direct_url=<?>,disk_format='qcow2',id=bccd0a29-f6e3-44b8-a7d5-2112f8374682,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-632402682',owner='2b0dcce533e44566820c42e5d984ce38',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T20:08:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '9bd0cbde-8bdb-4e4a-a87c-efe880341489', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbsOHinN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffba17c7-da25-4759-9181-5a8732e7438d', 'attached_at': '', 'detached_at': '', 'volume_id': '8cc0a711-bab3-4b33-a0ed-4ffe6986a17e', 'serial': '8cc0a711-bab3-4b33-a0ed-4ffe6986a17e'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:09:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:00 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T20:08:24Z,direct_url=<?>,disk_format='qcow2',id=bccd0a29-f6e3-44b8-a7d5-2112f8374682,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-632402682',owner='2b0dcce533e44566820c42e5d984ce38',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T20:08:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbsOHinN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:09:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:00 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576f292-4559-4aae-8244-0800ff54ba73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:09:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5054d00-0b43-4c01-974f-e118ece443a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e] added
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef57c96-1aee-496a-9092-c53e8486fe9c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7023973-3d28-44ee-981e-107271fc3191]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbsOHinN {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbsOHinN" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c2518-7806-47aa-b662-893c0c0ff43c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbsOHinN'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[28448651-94cb-43e4-bad1-ebf44e8ced91]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a5445-0fd8-424c-bc9d-a2e453805f4d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d0f58-9b6a-4bb8-8c6c-8fc11dc88e34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260]
Aug 16 20:09:00 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260] successful.
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dddc082-8c93-4502-a1a0-6f1d5d441a2d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[681117fb-115a-4ccc-b14d-106a2627205a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:00 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6702e-f845-4a28-820d-62a925fcf37e]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbsOHinN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23062613866316338', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062613866316338', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-664531567',id=23,image_ref='bccd0a29-f6e3-44b8-a7d5-2112f8374682',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVhdaHERbvGWOxXAnhgm1EltNa3qzC7CXljOLlsVnBEJVkPwsGnwWp5iiwd7qTYKQUPWiw1h9OicdsM50Wrv9gSU/PzsHYDlVzQhYV2Kji3hZfQhdTXfQdO7bArHiAXQ==',key_name='tempest-keypair-285832103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-2a02ypd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1700099963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=ffba17c7-da25-4759-9181-5a8732e7438d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid ffba17c7-da25-4759-9181-5a8732e7438d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:09:01 user nova-compute[72894]:   <uuid>ffba17c7-da25-4759-9181-5a8732e7438d</uuid>
Aug 16 20:09:01 user nova-compute[72894]:   <name>instance-00000017</name>
Aug 16 20:09:01 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:09:01 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:09:01 user nova-compute[72894]:   <metadata>
Aug 16 20:09:01 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:09:01 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-664531567</nova:name>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:09:00</nova:creationTime>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:09:01 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:09:01 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:owner>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:09:01 user nova-compute[72894]:       </nova:owner>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:root type="image" uuid="bccd0a29-f6e3-44b8-a7d5-2112f8374682"/>
Aug 16 20:09:01 user nova-compute[72894]:       <nova:ports>
Aug 16 20:09:01 user nova-compute[72894]:         <nova:port uuid="2904ccc4-2d12-4a35-8f81-84fb7fe7e769">
Aug 16 20:09:01 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:09:01 user nova-compute[72894]:         </nova:port>
Aug 16 20:09:01 user nova-compute[72894]:       </nova:ports>
Aug 16 20:09:01 user nova-compute[72894]:     </nova:instance>
Aug 16 20:09:01 user nova-compute[72894]:   </metadata>
Aug 16 20:09:01 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:09:01 user nova-compute[72894]:     <system>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="serial">ffba17c7-da25-4759-9181-5a8732e7438d</entry>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="uuid">ffba17c7-da25-4759-9181-5a8732e7438d</entry>
Aug 16 20:09:01 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:09:01 user nova-compute[72894]:     </system>
Aug 16 20:09:01 user nova-compute[72894]:   </sysinfo>
Aug 16 20:09:01 user nova-compute[72894]:   <os>
Aug 16 20:09:01 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:09:01 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:09:01 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:09:01 user nova-compute[72894]:   </os>
Aug 16 20:09:01 user nova-compute[72894]:   <features>
Aug 16 20:09:01 user nova-compute[72894]:     <acpi/>
Aug 16 20:09:01 user nova-compute[72894]:     <apic/>
Aug 16 20:09:01 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:09:01 user nova-compute[72894]:   </features>
Aug 16 20:09:01 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:09:01 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:09:01 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:09:01 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:09:01 user nova-compute[72894]:   </clock>
Aug 16 20:09:01 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:09:01 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:09:01 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:09:01 user nova-compute[72894]:   </cpu>
Aug 16 20:09:01 user nova-compute[72894]:   <devices>
Aug 16 20:09:01 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:09:01 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:09:01 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 20:09:01 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:09:01 user nova-compute[72894]:       <serial>8cc0a711-bab3-4b33-a0ed-4ffe6986a17e</serial>
Aug 16 20:09:01 user nova-compute[72894]:     </disk>
Aug 16 20:09:01 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:09:01 user nova-compute[72894]:       <mac address="fa:16:3e:79:77:19"/>
Aug 16 20:09:01 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:01 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:09:01 user nova-compute[72894]:       <target dev="tap2904ccc4-2d"/>
Aug 16 20:09:01 user nova-compute[72894]:     </interface>
Aug 16 20:09:01 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:09:01 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/ffba17c7-da25-4759-9181-5a8732e7438d/console.log" append="off"/>
Aug 16 20:09:01 user nova-compute[72894]:     </serial>
Aug 16 20:09:01 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:09:01 user nova-compute[72894]:     <video>
Aug 16 20:09:01 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:01 user nova-compute[72894]:     </video>
Aug 16 20:09:01 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:09:01 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:09:01 user nova-compute[72894]:     </rng>
Aug 16 20:09:01 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:09:01 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:09:01 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:09:01 user nova-compute[72894]:     </memballoon>
Aug 16 20:09:01 user nova-compute[72894]:   </devices>
Aug 16 20:09:01 user nova-compute[72894]: </domain>
Aug 16 20:09:01 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-664531567',id=23,image_ref='bccd0a29-f6e3-44b8-a7d5-2112f8374682',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVhdaHERbvGWOxXAnhgm1EltNa3qzC7CXljOLlsVnBEJVkPwsGnwWp5iiwd7qTYKQUPWiw1h9OicdsM50Wrv9gSU/PzsHYDlVzQhYV2Kji3hZfQhdTXfQdO7bArHiAXQ==',key_name='tempest-keypair-285832103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-2a02ypd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1700099963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=ffba17c7-da25-4759-9181-5a8732e7438d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG os_vif [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2904ccc4-2d, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2904ccc4-2d, col_values=(('external_ids', {'iface-id': '2904ccc4-2d12-4a35-8f81-84fb7fe7e769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:77:19', 'vm-uuid': 'ffba17c7-da25-4759-9181-5a8732e7438d'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:01 user nova-compute[72894]: INFO os_vif [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d')
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:09:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:79:77:19, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] No waiting events found dispatching network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:03 user nova-compute[72894]: WARNING nova.compute.manager [req-74ba90fe-82b9-404f-b627-835ff0d6d269 req-3965987a-e488-4cf3-9220-c963245c625c service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received unexpected event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 for instance with vm_state building and task_state spawning.
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:09:04 user nova-compute[72894]: INFO nova.compute.claims [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Claim successful on node user
Aug 16 20:09:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:09:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.virt.block_device [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Booting with volume-backed-image 60545238-42c7-459f-80c0-4238accb7183 at /dev/vda
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.policy [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c9bdeca6ea84622835b26c7565f148c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0853a75dd30c499288bb5e848f038580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] No waiting events found dispatching network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:05 user nova-compute[72894]: WARNING nova.compute.manager [req-cbdd242d-925c-48c7-84b5-a23d4eb963ca req-075d1126-027b-437a-9566-2f1c56f2fa89 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received unexpected event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 for instance with vm_state building and task_state spawning.
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216545.4895225, ffba17c7-da25-4759-9181-5a8732e7438d => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] VM Resumed (Lifecycle Event)
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Instance spawned successfully.
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216545.491016, ffba17c7-da25-4759-9181-5a8732e7438d => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] VM Started (Lifecycle Event)
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:05 user nova-compute[72894]: INFO nova.compute.manager [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Took 28.36 seconds to build instance.
Aug 16 20:09:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9dc98da3-c1f0-42a3-b3bb-e9d7ce96f83a tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.477s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Successfully created port: 3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:09:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Successfully updated port: 3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-changed-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Refreshing instance network info cache due to event network-changed-3c3b2f52-b6a1-44d7-9f39-c9419db01724. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] Acquiring lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance network_info: |[{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] Acquired lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:07 user nova-compute[72894]: DEBUG nova.network.neutron [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Refreshing network info cache for port 3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:09:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updated VIF entry in instance network info cache for port 3c3b2f52-b6a1-44d7-9f39-c9419db01724. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:09:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4075e683-e248-4e8a-854e-7a46e59ccf5c req-27f386c5-83ab-4c49-ace7-d367a72c3680 service nova] Releasing lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.utils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527a347-d4cb-41cf-b560-311355127033]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a0918-b91b-4d62-b385-0de26d55d316]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b7ed34-0b8d-43e5-9933-7586bd5d56a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6266d-2b18-45fd-9caa-72c704cef884]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:09:16 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:09:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786ced2-2610-4b70-9adb-aee95422ee85]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG os_brick.utils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating existing volume attachment record: ad239274-93fd-440f-9adb-75cb8d080e2c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:09:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:19 user nova-compute[72894]: INFO nova.compute.manager [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Terminating instance
Aug 16 20:09:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.compute.claims [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Claim successful on node user
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-cf5fc5ee-9b8c-4029-8961-5a5678394b28 req-a25c1596-adee-45e5-93fe-c5ba8c9fab13 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-unplugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Instance destroyed successfully.
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'resources' on Instance uuid 2073e7a0-b213-44da-9249-47ace2f78b84 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228818073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228818073',id=15,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuRbQ6N07kpVQdNWXxKjjhMnNk8l82FaLiXr7JemPfFPYqUm9+8nVNBPG07c5ZLgZyLfQpN2/vZy3mSP/uw9M0RWzh6GGwT9FqyP0Qt3bq3eM5XA/m3HXHkAhEIMNJUPw==',key_name='tempest-keypair-480767158',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:07:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-8074e0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=2073e7a0-b213-44da-9249-47ace2f78b84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "811bf633-15a4-4a39-8270-e8b54399cbed", "address": "fa:16:3e:c7:9a:b8", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811bf633-15", "ovs_interfaceid": "811bf633-15a4-4a39-8270-e8b54399cbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG os_vif [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap811bf633-15, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:09:20 user nova-compute[72894]: INFO os_vif [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:9a:b8,bridge_name='br-int',has_traffic_filtering=True,id=811bf633-15a4-4a39-8270-e8b54399cbed,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811bf633-15')
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Deleting instance files /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84_del
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Deletion of /opt/stack/data/nova/instances/2073e7a0-b213-44da-9249-47ace2f78b84_del complete
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.compute.manager [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.841s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:09:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:09:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:09:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:09:21 user nova-compute[72894]: INFO nova.virt.block_device [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Booting with volume b2886717-52f0-4bd3-b46d-2b0c7996cbfc at /dev/vda
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.utils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9aa821-6efc-4828-8008-0d29e683065a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca356e59-ebaf-4fd2-80f0-4e88d3925593]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG nova.policy [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6787ebe74f6445caa43d44813f58ab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d388dc7ba4643d198d2999ec1f87afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dad9ed-1c21-4ec0-bc72-3a6209957c21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec013b-13eb-4ada-af7f-1445d232e236]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:09:21 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:09:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b5005b-fdec-4a80-afe5-ccf3a5bf8af3]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG os_brick.utils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:09:21 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating existing volume attachment record: c5b6f400-e8fb-4c6d-8b93-df5133c298cb {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] Acquiring lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] Lock "2073e7a0-b213-44da-9249-47ace2f78b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] No waiting events found dispatching network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:22 user nova-compute[72894]: WARNING nova.compute.manager [req-92ec1de2-131f-41ed-9fa8-db781c56652d req-d8593b96-98fc-4f55-a40a-761924cc5748 service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received unexpected event network-vif-plugged-811bf633-15a4-4a39-8270-e8b54399cbed for instance with vm_state active and task_state deleting.
Aug 16 20:09:22 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:22 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Took 1.83 seconds to deallocate network for instance.
Aug 16 20:09:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Successfully created port: 41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:09:22 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:23 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Deleted allocations for instance 2073e7a0-b213-44da-9249-47ace2f78b84
Aug 16 20:09:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1012407e-b9ac-4f4f-9002-7c032590166e tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "2073e7a0-b213-44da-9249-47ace2f78b84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.516s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Successfully updated port: 41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:09:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance network_info: |[{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Received event network-vif-deleted-811bf633-15a4-4a39-8270-e8b54399cbed {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-changed-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Refreshing instance network info cache due to event network-changed-41a97b77-d117-472e-8d2b-524454350c6b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.network.neutron [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Refreshing network info cache for port 41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.network.neutron [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updated VIF entry in instance network info cache for port 41a97b77-d117-472e-8d2b-524454350c6b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG nova.network.neutron [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c908a762-465b-4228-8416-8bb1807c9927 req-d19a7821-d30a-46ed-bbb8-decf1662085a service nova] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:09:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Creating image(s)
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Ensure instance console log exists: /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start _get_guest_xml network_info=[{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ad239274-93fd-440f-9adb-75cb8d080e2c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e018532-ae8e-4b6f-9931-18a006bdfc78', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8cb30a6-f3be-4a0a-94a4-c544dd233d06', 'serial': 'f8cb30a6-f3be-4a0a-94a4-c544dd233d06'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:09:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:09:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:28 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecded29d-4ffb-41af-abfa-e76940e16e08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:09:28 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75798d-2fb1-4030-a8cf-a22375a2c313]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06] added
Aug 16 20:09:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb6e71d-b59b-49f4-8239-a3178cd0ef9f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad7ce6-a630-4707-99e5-d118ea018fff]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksSpUXEO {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksSpUXEO" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa27fc2-b8f7-418f-8a25-fa1ddb37bcd3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksSpUXEO'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[848dcdb9-3caf-4c62-ad04-c06d22fd3b12]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cea009-fcf6-4027-9e90-91093c2c30ee]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:28 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:28 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:28 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:28 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840a2da-9bbf-4669-9b03-93bd85e19d54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260]
Aug 16 20:09:29 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260] successful.
Aug 16 20:09:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[736eacc3-4609-40b9-b7ee-8ffdfe10f1df]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a240937-b918-4e93-b1e3-88cffcccdc82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:29 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedeb192-dec6-4662-b102-bccd783f1e5f]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:09:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23136313330613964', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136313330613964', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461249139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461249139',id=26,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-kblycte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:05Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=9e018532-ae8e-4b6f-9931-18a006bdfc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:09:30 user nova-compute[72894]:   <uuid>9e018532-ae8e-4b6f-9931-18a006bdfc78</uuid>
Aug 16 20:09:30 user nova-compute[72894]:   <name>instance-0000001a</name>
Aug 16 20:09:30 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:09:30 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:09:30 user nova-compute[72894]:   <metadata>
Aug 16 20:09:30 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:09:30 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1461249139</nova:name>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:09:28</nova:creationTime>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:09:30 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:09:30 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:owner>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 20:09:30 user nova-compute[72894]:       </nova:owner>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:09:30 user nova-compute[72894]:       <nova:ports>
Aug 16 20:09:30 user nova-compute[72894]:         <nova:port uuid="3c3b2f52-b6a1-44d7-9f39-c9419db01724">
Aug 16 20:09:30 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:09:30 user nova-compute[72894]:         </nova:port>
Aug 16 20:09:30 user nova-compute[72894]:       </nova:ports>
Aug 16 20:09:30 user nova-compute[72894]:     </nova:instance>
Aug 16 20:09:30 user nova-compute[72894]:   </metadata>
Aug 16 20:09:30 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:09:30 user nova-compute[72894]:     <system>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="serial">9e018532-ae8e-4b6f-9931-18a006bdfc78</entry>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="uuid">9e018532-ae8e-4b6f-9931-18a006bdfc78</entry>
Aug 16 20:09:30 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:09:30 user nova-compute[72894]:     </system>
Aug 16 20:09:30 user nova-compute[72894]:   </sysinfo>
Aug 16 20:09:30 user nova-compute[72894]:   <os>
Aug 16 20:09:30 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:09:30 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:09:30 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:09:30 user nova-compute[72894]:   </os>
Aug 16 20:09:30 user nova-compute[72894]:   <features>
Aug 16 20:09:30 user nova-compute[72894]:     <acpi/>
Aug 16 20:09:30 user nova-compute[72894]:     <apic/>
Aug 16 20:09:30 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:09:30 user nova-compute[72894]:   </features>
Aug 16 20:09:30 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:09:30 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:09:30 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:09:30 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:09:30 user nova-compute[72894]:   </clock>
Aug 16 20:09:30 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:09:30 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:09:30 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:09:30 user nova-compute[72894]:   </cpu>
Aug 16 20:09:30 user nova-compute[72894]:   <devices>
Aug 16 20:09:30 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:09:30 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:09:30 user nova-compute[72894]:       <source dev="/dev/sdd"/>
Aug 16 20:09:30 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:09:30 user nova-compute[72894]:       <serial>f8cb30a6-f3be-4a0a-94a4-c544dd233d06</serial>
Aug 16 20:09:30 user nova-compute[72894]:     </disk>
Aug 16 20:09:30 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:09:30 user nova-compute[72894]:       <mac address="fa:16:3e:b9:b7:b9"/>
Aug 16 20:09:30 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:30 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:09:30 user nova-compute[72894]:       <target dev="tap3c3b2f52-b6"/>
Aug 16 20:09:30 user nova-compute[72894]:     </interface>
Aug 16 20:09:30 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:09:30 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/console.log" append="off"/>
Aug 16 20:09:30 user nova-compute[72894]:     </serial>
Aug 16 20:09:30 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:09:30 user nova-compute[72894]:     <video>
Aug 16 20:09:30 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:30 user nova-compute[72894]:     </video>
Aug 16 20:09:30 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:09:30 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:09:30 user nova-compute[72894]:     </rng>
Aug 16 20:09:30 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:09:30 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:09:30 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:09:30 user nova-compute[72894]:     </memballoon>
Aug 16 20:09:30 user nova-compute[72894]:   </devices>
Aug 16 20:09:30 user nova-compute[72894]: </domain>
Aug 16 20:09:30 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461249139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461249139',id=26,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-kblycte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:05Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=9e018532-ae8e-4b6f-9931-18a006bdfc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG os_vif [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c3b2f52-b6, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c3b2f52-b6, col_values=(('external_ids', {'iface-id': '3c3b2f52-b6a1-44d7-9f39-c9419db01724', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:b7:b9', 'vm-uuid': '9e018532-ae8e-4b6f-9931-18a006bdfc78'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:30 user nova-compute[72894]: INFO os_vif [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6')
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:09:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:b9:b7:b9, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:09:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:09:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Creating image(s)
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Ensure instance console log exists: /opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start _get_guest_xml network_info=[{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'c5b6f400-e8fb-4c6d-8b93-df5133c298cb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f4bb0f9-a9ca-4bde-ae50-fd20e768d355', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2886717-52f0-4bd3-b46d-2b0c7996cbfc', 'serial': 'b2886717-52f0-4bd3-b46d-2b0c7996cbfc'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:09:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:09:33 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:33 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:09:33 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b97f6-9b5a-4259-bd64-77543bd2ca2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:09:33 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9c7a78-5031-4ae2-bbd6-10074261cfd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc] added
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ceeda-00fc-40a8-8a44-3809d326a8b5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e30114-20f1-4cc1-aaa7-42471777ac55]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfiNrAxy {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfiNrAxy" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ed887-a3d8-4cb0-a76c-1ece7a6f41c8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfiNrAxy'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec15a21-84c9-48b5-9420-5ecbe538974d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33afde-59fd-417e-86af-65a900f1ef17]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b1eee-3d97-4e8e-98ed-949ea5dfad57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]
Aug 16 20:09:33 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453cd92-1166-44b2-b595-68b57312fe4b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c7e38-a93c-4146-ab80-eb82c7da952a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:09:33 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:09:33 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c65df-6680-4ff5-a194-6ec582656940]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:09:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216574.065213, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Resumed (Lifecycle Event)
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance spawned successfully.
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216574.0699444, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Started (Lifecycle Event)
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:34 user nova-compute[72894]: INFO nova.compute.manager [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Took 29.92 seconds to build instance.
Aug 16 20:09:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2cc7936-5a02-408c-a904-5b766ef2f9e1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.042s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:34 user nova-compute[72894]: WARNING nova.compute.manager [req-9bd4ac4a-3844-44cf-9b85-f802c40bdf42 req-f4bfa9f5-e6bf-4643-9c95-f9caa42cb261 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state None.
Aug 16 20:09:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23065646130643062', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065646130643062', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:09:34 user nova-compute[72894]:   <uuid>4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</uuid>
Aug 16 20:09:34 user nova-compute[72894]:   <name>instance-0000001b</name>
Aug 16 20:09:34 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:09:34 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:09:34 user nova-compute[72894]:   <metadata>
Aug 16 20:09:34 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:09:34 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:09:34 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherA-server-962766217</nova:name>
Aug 16 20:09:34 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:09:33</nova:creationTime>
Aug 16 20:09:34 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:09:34 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:09:34 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:09:34 user nova-compute[72894]:       <nova:owner>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:user uuid="6787ebe74f6445caa43d44813f58ab21">tempest-ServerActionsTestOtherA-2019589976-project-member</nova:user>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:project uuid="0d388dc7ba4643d198d2999ec1f87afe">tempest-ServerActionsTestOtherA-2019589976</nova:project>
Aug 16 20:09:34 user nova-compute[72894]:       </nova:owner>
Aug 16 20:09:34 user nova-compute[72894]:       <nova:ports>
Aug 16 20:09:34 user nova-compute[72894]:         <nova:port uuid="41a97b77-d117-472e-8d2b-524454350c6b">
Aug 16 20:09:34 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:09:34 user nova-compute[72894]:         </nova:port>
Aug 16 20:09:34 user nova-compute[72894]:       </nova:ports>
Aug 16 20:09:34 user nova-compute[72894]:     </nova:instance>
Aug 16 20:09:34 user nova-compute[72894]:   </metadata>
Aug 16 20:09:34 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:09:34 user nova-compute[72894]:     <system>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="serial">4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</entry>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="uuid">4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</entry>
Aug 16 20:09:34 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:09:34 user nova-compute[72894]:     </system>
Aug 16 20:09:34 user nova-compute[72894]:   </sysinfo>
Aug 16 20:09:34 user nova-compute[72894]:   <os>
Aug 16 20:09:34 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:09:34 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:09:34 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:09:34 user nova-compute[72894]:   </os>
Aug 16 20:09:34 user nova-compute[72894]:   <features>
Aug 16 20:09:34 user nova-compute[72894]:     <acpi/>
Aug 16 20:09:34 user nova-compute[72894]:     <apic/>
Aug 16 20:09:34 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:09:34 user nova-compute[72894]:   </features>
Aug 16 20:09:34 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:09:34 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:09:34 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:09:34 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:09:34 user nova-compute[72894]:   </clock>
Aug 16 20:09:34 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:09:34 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:09:34 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:09:34 user nova-compute[72894]:   </cpu>
Aug 16 20:09:34 user nova-compute[72894]:   <devices>
Aug 16 20:09:34 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:09:34 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:09:34 user nova-compute[72894]:       <source dev="/dev/sde"/>
Aug 16 20:09:34 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:09:34 user nova-compute[72894]:       <serial>b2886717-52f0-4bd3-b46d-2b0c7996cbfc</serial>
Aug 16 20:09:34 user nova-compute[72894]:     </disk>
Aug 16 20:09:34 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:09:34 user nova-compute[72894]:       <mac address="fa:16:3e:cb:2f:e1"/>
Aug 16 20:09:34 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:34 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:09:34 user nova-compute[72894]:       <target dev="tap41a97b77-d1"/>
Aug 16 20:09:34 user nova-compute[72894]:     </interface>
Aug 16 20:09:34 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:09:34 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355/console.log" append="off"/>
Aug 16 20:09:34 user nova-compute[72894]:     </serial>
Aug 16 20:09:34 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:09:34 user nova-compute[72894]:     <video>
Aug 16 20:09:34 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:34 user nova-compute[72894]:     </video>
Aug 16 20:09:34 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:09:34 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:09:34 user nova-compute[72894]:     </rng>
Aug 16 20:09:34 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:09:34 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:09:34 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:09:34 user nova-compute[72894]:     </memballoon>
Aug 16 20:09:34 user nova-compute[72894]:   </devices>
Aug 16 20:09:34 user nova-compute[72894]: </domain>
Aug 16 20:09:34 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG os_vif [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41a97b77-d1, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41a97b77-d1, col_values=(('external_ids', {'iface-id': '41a97b77-d117-472e-8d2b-524454350c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2f:e1', 'vm-uuid': '4f4bb0f9-a9ca-4bde-ae50-fd20e768d355'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:35 user nova-compute[72894]: INFO os_vif [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1')
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:cb:2f:e1, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216560.496, 2073e7a0-b213-44da-9249-47ace2f78b84 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:35 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] VM Stopped (Lifecycle Event)
Aug 16 20:09:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b5e1033f-4ae7-4279-9f13-e83528f206d1 None None] [instance: 2073e7a0-b213-44da-9249-47ace2f78b84] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:36 user nova-compute[72894]: WARNING nova.compute.manager [req-f6882bfd-93a4-40ea-a72f-bfcbfb324c73 req-ab697e88-8d93-486f-b02b-d1a18bc6b819 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state None.
Aug 16 20:09:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216579.0254688, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Resumed (Lifecycle Event)
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance spawned successfully.
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216579.0273252, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Started (Lifecycle Event)
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:39 user nova-compute[72894]: INFO nova.compute.manager [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Took 19.68 seconds to build instance.
Aug 16 20:09:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-660a7ef3-327e-45e3-b29b-d4be83464dcb tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.817s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:09:41 user nova-compute[72894]: INFO nova.compute.claims [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Claim successful on node user
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:41 user nova-compute[72894]: WARNING nova.compute.manager [req-9f71978d-9fd0-4137-a455-ae0118770c97 req-05134ae4-dc4b-4601-bbb2-aec2a7212abe service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state None.
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:09:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:09:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.policy [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b26e4d21c54640919f6cb9b2f010dc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1c256d8fe54527ac7f6decf747f0a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:09:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Creating image(s)
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "/opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "/opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "/opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.208s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk 1073741824" returned: 0 in 0.052s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Successfully created port: eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Cannot resize image /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'migration_context' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Ensure instance console log exists: /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:43 user nova-compute[72894]: WARNING nova.compute.manager [req-37cf7a92-3c0f-4224-a20a-586b3a99d670 req-b1448347-ca0c-46af-a434-616c01f3b6f5 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state None.
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Successfully updated port: eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:09:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquired lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating instance_info_cache with network_info: [{"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:44 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:44 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=24.33458709716797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Releasing lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Instance network_info: |[{"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Start _get_guest_xml network_info=[{"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:09:44 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:44 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1820240320',display_name='tempest-TestServerVolumeAttachmentScenario-server-1820240320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1820240320',id=28,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI459cuE0qLXm3kX2FOJx/aR81hz2IEEmTubvnDhVWF7zLFCD5a5+Td+CbGyC8BfI/FEjEM/ItO2C5Spnu7b83wpA3uZRKLmu+cLKi7QkwQO9DW7yh26syz9b+6jhedbaQ==',key_name='tempest-keypair-201223740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1c256d8fe54527ac7f6decf747f0a8',ramdisk_id='',reservation_id='r-7pzva80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1423853584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1423853584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26e4d21c54640919f6cb9b2f010dc43',uuid=cef80969-a51d-46a1-a5b1-d510ecb97f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converting VIF {"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'pci_devices' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:09:45 user nova-compute[72894]:   <uuid>cef80969-a51d-46a1-a5b1-d510ecb97f81</uuid>
Aug 16 20:09:45 user nova-compute[72894]:   <name>instance-0000001c</name>
Aug 16 20:09:45 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:09:45 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:09:45 user nova-compute[72894]:   <metadata>
Aug 16 20:09:45 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:09:45 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1820240320</nova:name>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:09:44</nova:creationTime>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:09:45 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:09:45 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:owner>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:user uuid="b26e4d21c54640919f6cb9b2f010dc43">tempest-TestServerVolumeAttachmentScenario-1423853584-project-member</nova:user>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:project uuid="cc1c256d8fe54527ac7f6decf747f0a8">tempest-TestServerVolumeAttachmentScenario-1423853584</nova:project>
Aug 16 20:09:45 user nova-compute[72894]:       </nova:owner>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:09:45 user nova-compute[72894]:       <nova:ports>
Aug 16 20:09:45 user nova-compute[72894]:         <nova:port uuid="eefb938d-3ca8-424e-aa08-c4139d8cd81c">
Aug 16 20:09:45 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:09:45 user nova-compute[72894]:         </nova:port>
Aug 16 20:09:45 user nova-compute[72894]:       </nova:ports>
Aug 16 20:09:45 user nova-compute[72894]:     </nova:instance>
Aug 16 20:09:45 user nova-compute[72894]:   </metadata>
Aug 16 20:09:45 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:09:45 user nova-compute[72894]:     <system>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="serial">cef80969-a51d-46a1-a5b1-d510ecb97f81</entry>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="uuid">cef80969-a51d-46a1-a5b1-d510ecb97f81</entry>
Aug 16 20:09:45 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:09:45 user nova-compute[72894]:     </system>
Aug 16 20:09:45 user nova-compute[72894]:   </sysinfo>
Aug 16 20:09:45 user nova-compute[72894]:   <os>
Aug 16 20:09:45 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:09:45 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:09:45 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:09:45 user nova-compute[72894]:   </os>
Aug 16 20:09:45 user nova-compute[72894]:   <features>
Aug 16 20:09:45 user nova-compute[72894]:     <acpi/>
Aug 16 20:09:45 user nova-compute[72894]:     <apic/>
Aug 16 20:09:45 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:09:45 user nova-compute[72894]:   </features>
Aug 16 20:09:45 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:09:45 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:09:45 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:09:45 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:09:45 user nova-compute[72894]:   </clock>
Aug 16 20:09:45 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:09:45 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:09:45 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:09:45 user nova-compute[72894]:   </cpu>
Aug 16 20:09:45 user nova-compute[72894]:   <devices>
Aug 16 20:09:45 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:09:45 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:09:45 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk"/>
Aug 16 20:09:45 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:09:45 user nova-compute[72894]:     </disk>
Aug 16 20:09:45 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:09:45 user nova-compute[72894]:       <mac address="fa:16:3e:5e:d2:44"/>
Aug 16 20:09:45 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:45 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:09:45 user nova-compute[72894]:       <target dev="tapeefb938d-3c"/>
Aug 16 20:09:45 user nova-compute[72894]:     </interface>
Aug 16 20:09:45 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:09:45 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/console.log" append="off"/>
Aug 16 20:09:45 user nova-compute[72894]:     </serial>
Aug 16 20:09:45 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:09:45 user nova-compute[72894]:     <video>
Aug 16 20:09:45 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:09:45 user nova-compute[72894]:     </video>
Aug 16 20:09:45 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:09:45 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:09:45 user nova-compute[72894]:     </rng>
Aug 16 20:09:45 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:09:45 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:09:45 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:09:45 user nova-compute[72894]:     </memballoon>
Aug 16 20:09:45 user nova-compute[72894]:   </devices>
Aug 16 20:09:45 user nova-compute[72894]: </domain>
Aug 16 20:09:45 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1820240320',display_name='tempest-TestServerVolumeAttachmentScenario-server-1820240320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1820240320',id=28,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI459cuE0qLXm3kX2FOJx/aR81hz2IEEmTubvnDhVWF7zLFCD5a5+Td+CbGyC8BfI/FEjEM/ItO2C5Spnu7b83wpA3uZRKLmu+cLKi7QkwQO9DW7yh26syz9b+6jhedbaQ==',key_name='tempest-keypair-201223740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1c256d8fe54527ac7f6decf747f0a8',ramdisk_id='',reservation_id='r-7pzva80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1423853584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1423853584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26e4d21c54640919f6cb9b2f010dc43',uuid=cef80969-a51d-46a1-a5b1-d510ecb97f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converting VIF {"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG os_vif [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeefb938d-3c, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeefb938d-3c, col_values=(('external_ids', {'iface-id': 'eefb938d-3ca8-424e-aa08-c4139d8cd81c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d2:44', 'vm-uuid': 'cef80969-a51d-46a1-a5b1-d510ecb97f81'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:09:45 user nova-compute[72894]: INFO os_vif [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c')
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 67838895-188d-42ea-9197-a9d8dc841ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance ffba17c7-da25-4759-9181-5a8732e7438d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e58319ae-a089-4b57-ad1b-922763b58293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No VIF found with MAC fa:16:3e:5e:d2:44, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-changed-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Refreshing instance network info cache due to event network-changed-eefb938d-3ca8-424e-aa08-c4139d8cd81c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] Acquiring lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] Acquired lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:09:45 user nova-compute[72894]: DEBUG nova.network.neutron [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Refreshing network info cache for port eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updated VIF entry in instance network info cache for port eefb938d-3ca8-424e-aa08-c4139d8cd81c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating instance_info_cache with network_info: [{"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-684007a8-083a-4c22-8e08-f7a3b017a240 req-587198c3-d07a-49f4-8fb6-2bb918e8b5b8 service nova] Releasing lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] No waiting events found dispatching network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:46 user nova-compute[72894]: WARNING nova.compute.manager [req-7be1dd6e-4097-4139-934d-c579619417c6 req-c55b1b64-620d-4b30-9d42-7f04c74ca946 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received unexpected event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c for instance with vm_state building and task_state spawning.
Aug 16 20:09:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216588.7928364, cef80969-a51d-46a1-a5b1-d510ecb97f81 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] VM Resumed (Lifecycle Event)
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Instance spawned successfully.
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] No waiting events found dispatching network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:09:48 user nova-compute[72894]: WARNING nova.compute.manager [req-940bf876-e8b2-4ef3-9f5b-d8955794fed8 req-74633a11-775a-4d8a-af4e-fb7675e3df01 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received unexpected event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c for instance with vm_state building and task_state spawning.
Aug 16 20:09:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216588.794357, cef80969-a51d-46a1-a5b1-d510ecb97f81 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] VM Started (Lifecycle Event)
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:09:48 user nova-compute[72894]: INFO nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 16 20:09:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:09:49 user nova-compute[72894]: INFO nova.compute.manager [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Took 7.91 seconds to build instance.
Aug 16 20:09:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b2521e2e-36fe-4161-aaeb-8caec56fb547 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.267s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:09:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:09:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:09:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:09 user nova-compute[72894]: INFO nova.compute.manager [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Unrescuing
Aug 16 20:10:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:10:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'flavor' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:10 user nova-compute[72894]: WARNING nova.compute.manager [req-d7e9858c-be3e-4f31-9d67-79e62eec7d1c req-904e9794-6d56-42b9-8e87-c39f33305765 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance destroyed successfully.
Aug 16 20:10:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:12 user nova-compute[72894]: WARNING nova.compute.manager [req-6c369384-8841-430f-9aa7-93b7e0e96f56 req-19d583c0-32ec-4d03-85ed-bffa8f84395b service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:10:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:14 user nova-compute[72894]: WARNING nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:14 user nova-compute[72894]: WARNING nova.compute.manager [req-4e9d85f1-fdf8-49b8-97b9-964c761c4558 req-09ab915b-efa8-4dcf-8fcb-af961a6d48ca service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 60dd6c6f-825a-4367-a215-c3989d1db134 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216614.6888597, 60dd6c6f-825a-4367-a215-c3989d1db134 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Resumed (Lifecycle Event)
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-98457863-cb20-4d7b-9f51-04385a23b48a tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216614.6976328, 60dd6c6f-825a-4367-a215-c3989d1db134 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Started (Lifecycle Event)
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:10:15 user nova-compute[72894]: INFO nova.compute.claims [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Claim successful on node user
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:10:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:10:15 user nova-compute[72894]: DEBUG nova.policy [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '387415e40279468eaf69c06b271be2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a14259280244b3ad64ea5fb30ce7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:10:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Creating image(s)
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.295s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk 1073741824" returned: 0 in 0.067s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Successfully created port: 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.244s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:10:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Cannot resize image /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'migration_context' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Ensure instance console log exists: /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Successfully updated port: 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing instance network info cache due to event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance network_info: |[{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start _get_guest_xml network_info=[{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:10:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXqJQ3OSCxbhn6FeS/X4MuALkvHiA46IOCQJPAvjaSPbelmIfJEP+4QzoIOU8aU8a/gxD1LBAsiurn0QfipO/CiOmj55xCkUnEmbwylWMUBJ3smZpDdgTOOOhgqapdI0Q==',key_name='tempest-keypair-1947199152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_devices' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:10:18 user nova-compute[72894]:   <uuid>34d11735-e89e-4695-9ca5-d596a7b736b1</uuid>
Aug 16 20:10:18 user nova-compute[72894]:   <name>instance-0000001d</name>
Aug 16 20:10:18 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:10:18 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:10:18 user nova-compute[72894]:   <metadata>
Aug 16 20:10:18 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:10:18 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1251306969</nova:name>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:10:18</nova:creationTime>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:10:18 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:10:18 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:owner>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:user uuid="387415e40279468eaf69c06b271be2c9">tempest-AttachVolumeShelveTestJSON-1527512383-project-member</nova:user>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:project uuid="53a14259280244b3ad64ea5fb30ce7bf">tempest-AttachVolumeShelveTestJSON-1527512383</nova:project>
Aug 16 20:10:18 user nova-compute[72894]:       </nova:owner>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:10:18 user nova-compute[72894]:       <nova:ports>
Aug 16 20:10:18 user nova-compute[72894]:         <nova:port uuid="4ae15471-0ba2-4aec-972a-3733caa98570">
Aug 16 20:10:18 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:10:18 user nova-compute[72894]:         </nova:port>
Aug 16 20:10:18 user nova-compute[72894]:       </nova:ports>
Aug 16 20:10:18 user nova-compute[72894]:     </nova:instance>
Aug 16 20:10:18 user nova-compute[72894]:   </metadata>
Aug 16 20:10:18 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:10:18 user nova-compute[72894]:     <system>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="serial">34d11735-e89e-4695-9ca5-d596a7b736b1</entry>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="uuid">34d11735-e89e-4695-9ca5-d596a7b736b1</entry>
Aug 16 20:10:18 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:10:18 user nova-compute[72894]:     </system>
Aug 16 20:10:18 user nova-compute[72894]:   </sysinfo>
Aug 16 20:10:18 user nova-compute[72894]:   <os>
Aug 16 20:10:18 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:10:18 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:10:18 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:10:18 user nova-compute[72894]:   </os>
Aug 16 20:10:18 user nova-compute[72894]:   <features>
Aug 16 20:10:18 user nova-compute[72894]:     <acpi/>
Aug 16 20:10:18 user nova-compute[72894]:     <apic/>
Aug 16 20:10:18 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:10:18 user nova-compute[72894]:   </features>
Aug 16 20:10:18 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:10:18 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:10:18 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:10:18 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:10:18 user nova-compute[72894]:   </clock>
Aug 16 20:10:18 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:10:18 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:10:18 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:10:18 user nova-compute[72894]:   </cpu>
Aug 16 20:10:18 user nova-compute[72894]:   <devices>
Aug 16 20:10:18 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:10:18 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:10:18 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk"/>
Aug 16 20:10:18 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:10:18 user nova-compute[72894]:     </disk>
Aug 16 20:10:18 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:10:18 user nova-compute[72894]:       <mac address="fa:16:3e:b9:8e:77"/>
Aug 16 20:10:18 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:18 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:10:18 user nova-compute[72894]:       <target dev="tap4ae15471-0b"/>
Aug 16 20:10:18 user nova-compute[72894]:     </interface>
Aug 16 20:10:18 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:10:18 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/console.log" append="off"/>
Aug 16 20:10:18 user nova-compute[72894]:     </serial>
Aug 16 20:10:18 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:10:18 user nova-compute[72894]:     <video>
Aug 16 20:10:18 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:18 user nova-compute[72894]:     </video>
Aug 16 20:10:18 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:10:18 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:10:18 user nova-compute[72894]:     </rng>
Aug 16 20:10:18 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:10:18 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:10:18 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:10:18 user nova-compute[72894]:     </memballoon>
Aug 16 20:10:18 user nova-compute[72894]:   </devices>
Aug 16 20:10:18 user nova-compute[72894]: </domain>
Aug 16 20:10:18 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXqJQ3OSCxbhn6FeS/X4MuALkvHiA46IOCQJPAvjaSPbelmIfJEP+4QzoIOU8aU8a/gxD1LBAsiurn0QfipO/CiOmj55xCkUnEmbwylWMUBJ3smZpDdgTOOOhgqapdI0Q==',key_name='tempest-keypair-1947199152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG os_vif [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae15471-0b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ae15471-0b, col_values=(('external_ids', {'iface-id': '4ae15471-0ba2-4aec-972a-3733caa98570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:8e:77', 'vm-uuid': '34d11735-e89e-4695-9ca5-d596a7b736b1'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:18 user nova-compute[72894]: INFO os_vif [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b')
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No VIF found with MAC fa:16:3e:b9:8e:77, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updated VIF entry in instance network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:10:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8eb9fe5c-1f42-49f7-ae80-acad401c3615 req-3fa54a22-1e11-49c6-8fd0-2d2e01ca4cd4 service nova] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:21 user nova-compute[72894]: WARNING nova.compute.manager [req-33cd8c1a-005d-4d9c-93bb-9ae4f11c3b98 req-4940fbb3-c2c5-4aff-a945-b62b081353eb service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state building and task_state spawning.
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216622.4370368, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Resumed (Lifecycle Event)
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance spawned successfully.
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216622.4374971, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Started (Lifecycle Event)
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Took 6.51 seconds to spawn the instance on the hypervisor.
Aug 16 20:10:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:10:22 user nova-compute[72894]: INFO nova.compute.manager [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Took 7.59 seconds to build instance.
Aug 16 20:10:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d536e8fe-0a8b-4cda-be92-63f3f6d004aa tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.700s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:23 user nova-compute[72894]: WARNING nova.compute.manager [req-0ddce4e8-ebad-4e87-a5fa-db8f18cd22a2 req-1076d7dd-6ad9-4c9d-9125-4938540dd97c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state active and task_state None.
Aug 16 20:10:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:10:25 user nova-compute[72894]: INFO nova.compute.claims [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Claim successful on node user
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:10:25 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:10:25 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Creating image(s)
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:25 user nova-compute[72894]: DEBUG nova.policy [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b2c321a6776409a9dea0f817f58e07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28ea40d38684e26a5abd0292d031801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG nova.virt.images [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] 09029edf-bcb8-4a49-819b-f792f8fb87bb was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.part /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Successfully created port: 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.part /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.converted" returned: 0 in 0.425s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.236s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d,backing_fmt=raw /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Successfully updated port: 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d,backing_fmt=raw /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk 1073741824" returned: 0 in 0.057s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing instance network info cache due to event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Cannot resize image /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'migration_context' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Ensure instance console log exists: /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-08949952-b70c-4182-af16-6e072587d92f req-c67d607b-d1c7-4113-8f15-8b2b607f8c33 service nova] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-changed-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Refreshing instance network info cache due to event network-changed-2904ccc4-2d12-4a35-8f81-84fb7fe7e769. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] Acquiring lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] Acquired lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Refreshing network info cache for port 2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:29 user nova-compute[72894]: INFO nova.compute.manager [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Terminating instance
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-unplugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] No waiting events found dispatching network-vif-unplugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-de2ccaa2-37d1-4e7d-9422-b25809d3ff55 req-17f04dad-ddb9-4219-bd2f-d4c85c7f0c08 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-unplugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance network_info: |[{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start _get_guest_xml network_info=[{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T20:10:22Z,direct_url=<?>,disk_format='qcow2',id=09029edf-bcb8-4a49-819b-f792f8fb87bb,min_disk=0,min_ram=0,name='tempest-scenario-img--536615507',owner='d28ea40d38684e26a5abd0292d031801',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T20:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '09029edf-bcb8-4a49-819b-f792f8fb87bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:10:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T20:10:22Z,direct_url=<?>,disk_format='qcow2',id=09029edf-bcb8-4a49-819b-f792f8fb87bb,min_disk=0,min_ram=0,name='tempest-scenario-img--536615507',owner='d28ea40d38684e26a5abd0292d031801',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T20:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:10:26Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'pci_devices' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:10:29 user nova-compute[72894]:   <uuid>e3fa3ace-3292-4957-aa6a-98f14b12795f</uuid>
Aug 16 20:10:29 user nova-compute[72894]:   <name>instance-0000001e</name>
Aug 16 20:10:29 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:10:29 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:10:29 user nova-compute[72894]:   <metadata>
Aug 16 20:10:29 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:10:29 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:name>tempest-TestMinimumBasicScenario-server-267363048</nova:name>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:10:29</nova:creationTime>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:10:29 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:10:29 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:owner>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:user uuid="1b2c321a6776409a9dea0f817f58e07a">tempest-TestMinimumBasicScenario-872391646-project-member</nova:user>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:project uuid="d28ea40d38684e26a5abd0292d031801">tempest-TestMinimumBasicScenario-872391646</nova:project>
Aug 16 20:10:29 user nova-compute[72894]:       </nova:owner>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:root type="image" uuid="09029edf-bcb8-4a49-819b-f792f8fb87bb"/>
Aug 16 20:10:29 user nova-compute[72894]:       <nova:ports>
Aug 16 20:10:29 user nova-compute[72894]:         <nova:port uuid="22bcca30-6f46-415c-be4a-92cb214928e8">
Aug 16 20:10:29 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:10:29 user nova-compute[72894]:         </nova:port>
Aug 16 20:10:29 user nova-compute[72894]:       </nova:ports>
Aug 16 20:10:29 user nova-compute[72894]:     </nova:instance>
Aug 16 20:10:29 user nova-compute[72894]:   </metadata>
Aug 16 20:10:29 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:10:29 user nova-compute[72894]:     <system>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="serial">e3fa3ace-3292-4957-aa6a-98f14b12795f</entry>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="uuid">e3fa3ace-3292-4957-aa6a-98f14b12795f</entry>
Aug 16 20:10:29 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:10:29 user nova-compute[72894]:     </system>
Aug 16 20:10:29 user nova-compute[72894]:   </sysinfo>
Aug 16 20:10:29 user nova-compute[72894]:   <os>
Aug 16 20:10:29 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:10:29 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:10:29 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:10:29 user nova-compute[72894]:   </os>
Aug 16 20:10:29 user nova-compute[72894]:   <features>
Aug 16 20:10:29 user nova-compute[72894]:     <acpi/>
Aug 16 20:10:29 user nova-compute[72894]:     <apic/>
Aug 16 20:10:29 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:10:29 user nova-compute[72894]:   </features>
Aug 16 20:10:29 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:10:29 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:10:29 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:10:29 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:10:29 user nova-compute[72894]:   </clock>
Aug 16 20:10:29 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:10:29 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:10:29 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:10:29 user nova-compute[72894]:   </cpu>
Aug 16 20:10:29 user nova-compute[72894]:   <devices>
Aug 16 20:10:29 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:10:29 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:10:29 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk"/>
Aug 16 20:10:29 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:10:29 user nova-compute[72894]:     </disk>
Aug 16 20:10:29 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:10:29 user nova-compute[72894]:       <mac address="fa:16:3e:59:d1:ae"/>
Aug 16 20:10:29 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:29 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:10:29 user nova-compute[72894]:       <target dev="tap22bcca30-6f"/>
Aug 16 20:10:29 user nova-compute[72894]:     </interface>
Aug 16 20:10:29 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:10:29 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/console.log" append="off"/>
Aug 16 20:10:29 user nova-compute[72894]:     </serial>
Aug 16 20:10:29 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:10:29 user nova-compute[72894]:     <video>
Aug 16 20:10:29 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:29 user nova-compute[72894]:     </video>
Aug 16 20:10:29 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:10:29 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:10:29 user nova-compute[72894]:     </rng>
Aug 16 20:10:29 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:10:29 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:10:29 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:10:29 user nova-compute[72894]:     </memballoon>
Aug 16 20:10:29 user nova-compute[72894]:   </devices>
Aug 16 20:10:29 user nova-compute[72894]: </domain>
Aug 16 20:10:29 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:10:26Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG os_vif [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bcca30-6f, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22bcca30-6f, col_values=(('external_ids', {'iface-id': '22bcca30-6f46-415c-be4a-92cb214928e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:d1:ae', 'vm-uuid': 'e3fa3ace-3292-4957-aa6a-98f14b12795f'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:29 user nova-compute[72894]: INFO os_vif [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f')
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No VIF found with MAC fa:16:3e:59:d1:ae, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updated VIF entry in instance network info cache for port 2904ccc4-2d12-4a35-8f81-84fb7fe7e769. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updating instance_info_cache with network_info: [{"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75cb89d0-15a6-4a8c-a11a-3b8b796ef9bf req-97ed02fb-4655-47f6-b26d-0e20024dc510 service nova] Releasing lock "refresh_cache-ffba17c7-da25-4759-9181-5a8732e7438d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Instance destroyed successfully.
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid ffba17c7-da25-4759-9181-5a8732e7438d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-664531567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-664531567',id=23,image_ref='bccd0a29-f6e3-44b8-a7d5-2112f8374682',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVhdaHERbvGWOxXAnhgm1EltNa3qzC7CXljOLlsVnBEJVkPwsGnwWp5iiwd7qTYKQUPWiw1h9OicdsM50Wrv9gSU/PzsHYDlVzQhYV2Kji3hZfQhdTXfQdO7bArHiAXQ==',key_name='tempest-keypair-285832103',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-2a02ypd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1700099963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=ffba17c7-da25-4759-9181-5a8732e7438d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "address": "fa:16:3e:79:77:19", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2904ccc4-2d", "ovs_interfaceid": "2904ccc4-2d12-4a35-8f81-84fb7fe7e769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_vif [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2904ccc4-2d, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:30 user nova-compute[72894]: INFO os_vif [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:19,bridge_name='br-int',has_traffic_filtering=True,id=2904ccc4-2d12-4a35-8f81-84fb7fe7e769,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2904ccc4-2d')
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbsOHinN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:30 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4741a-c1b9-494a-9abb-1ef237aad0ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7d5cd-3198-42e8-b9b9-32bfd2aa3ef6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:30 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c4b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea225ad-5b1f-4761-afbb-bc93903d106d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db89cc-615f-489d-8e9f-f033ea9cf161]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[160991a8-c726-4b5c-a4b0-2c386c1de7ca]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8534b8-0992-41c8-a8a6-ace606c06f6c]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2478ba-4eb7-44c2-ab95-99c114e387af]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-changed-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Refreshing instance network info cache due to event network-changed-ee56abab-abe8-485f-a994-e4922696e53e. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] Acquiring lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] Acquired lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.network.neutron [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Refreshing network info cache for port ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e8f3e2-a7a6-4243-ba66-2ffb2ac51a12]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260]
Aug 16 20:10:30 user nova-compute[72894]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e, portal: 172.16.0.220,3260] successful.
Aug 16 20:10:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc0a711-bab3-4b33-a0ed-4ffe6986a17e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2368a-43cf-45ea-900a-0401abff5f8a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (333ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:10:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Deleting instance files /opt/stack/data/nova/instances/ffba17c7-da25-4759-9181-5a8732e7438d_del
Aug 16 20:10:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Deletion of /opt/stack/data/nova/instances/ffba17c7-da25-4759-9181-5a8732e7438d_del complete
Aug 16 20:10:30 user nova-compute[72894]: INFO nova.compute.manager [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 16 20:10:30 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:10:30 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] Acquiring lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] Lock "ffba17c7-da25-4759-9181-5a8732e7438d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] No waiting events found dispatching network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:31 user nova-compute[72894]: WARNING nova.compute.manager [req-8d767af4-4003-4dcf-a783-bb65572fd9de req-4f0aabb3-18dd-4a2a-84a9-19b83a828670 service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received unexpected event network-vif-plugged-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 for instance with vm_state active and task_state deleting.
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-changed-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Refreshing instance network info cache due to event network-changed-6239d484-f4a5-45cc-8ebf-19d2291c1bcf. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] Acquiring lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] Acquired lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.network.neutron [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Refreshing network info cache for port 6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.network.neutron [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updated VIF entry in instance network info cache for port ee56abab-abe8-485f-a994-e4922696e53e. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG nova.network.neutron [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updating instance_info_cache with network_info: [{"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-28c1f898-d457-4b87-852e-845ffbd39652 req-14aa62c0-a31a-44e2-8d88-2ec8a8c0ccdc service nova] Releasing lock "refresh_cache-eee52fdd-dc11-4f58-9e51-483a6a771403" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Ignoring supplied device name: /dev/vdb
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.347s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updated VIF entry in instance network info cache for port 6239d484-f4a5-45cc-8ebf-19d2291c1bcf. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updating instance_info_cache with network_info: [{"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a5b87cdb-8551-4213-bfb2-74cd7d31cf8b req-485f7000-d063-4606-a7b1-19dc7c837365 service nova] Releasing lock "refresh_cache-e58319ae-a089-4b57-ad1b-922763b58293" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:32 user nova-compute[72894]: INFO nova.compute.manager [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Attaching volume 4a5ee702-d57d-49ee-a698-a05f32b150ae to /dev/vdb
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:32 user nova-compute[72894]: WARNING nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state building and task_state spawning.
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:32 user nova-compute[72894]: WARNING nova.compute.manager [req-d9e5e07b-c35c-49ff-985e-cb1bca4fab50 req-62d16414-984e-42b2-a876-5df2093585c5 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state building and task_state spawning.
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.utils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca5334-67c2-4a58-828f-9d43ddd406e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df309e95-1304-499a-a67b-827df78a0ff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32a9b91-dd52-4913-aa90-229ffeefe6ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f14cf-0f5e-460b-b20f-54b5a120bfac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:10:32 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:10:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a37552-9138-4312-b8a0-c894cd29dde9]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG os_brick.utils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updating existing volume attachment record: 3c0a2a6c-c568-4356-8bfe-2fd9a40053aa {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:10:32 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:32 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Took 2.19 seconds to deallocate network for instance.
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216633.6342533, e3fa3ace-3292-4957-aa6a-98f14b12795f => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] VM Resumed (Lifecycle Event)
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance spawned successfully.
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216633.6365411, e3fa3ace-3292-4957-aa6a-98f14b12795f => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] VM Started (Lifecycle Event)
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:10:33 user nova-compute[72894]: INFO nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Took 7.90 seconds to spawn the instance on the hypervisor.
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-e3dc692a-ce24-49c0-8726-8c127bbc1aa4 req-d4946fa3-3a3e-45ce-91ed-83c66d19ab0f service nova] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Received event network-vif-deleted-2904ccc4-2d12-4a35-8f81-84fb7fe7e769 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:34 user nova-compute[72894]: INFO nova.compute.manager [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Took 8.96 seconds to build instance.
Aug 16 20:10:34 user nova-compute[72894]: INFO nova.compute.manager [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Took 1.15 seconds to detach 1 volumes for instance.
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ef329014-5939-4845-87a2-45cf005897c4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.151s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Deleting volume: 8cc0a711-bab3-4b33-a0ed-4ffe6986a17e {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:34 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance ffba17c7-da25-4759-9181-5a8732e7438d
Aug 16 20:10:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5cb63f4c-9001-4d8f-a9e8-103b3560777e tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "ffba17c7-da25-4759-9181-5a8732e7438d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.880s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'flavor' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:35 user nova-compute[72894]: INFO nova.compute.manager [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Attaching volume d11661a9-9041-4a55-a63c-8d0387c1ce53 to /dev/vdb
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.utils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc23c5d-a723-4fd4-9bbf-be8dfb7b4e6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60d5e0-28ca-47bd-b14a-7fa24e41f1b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0229f77d-759e-4f7d-9f4c-418dd31ab3fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6d0350-7985-407c-8e11-32472c69e2af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:10:35 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:10:35 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c7571-fd45-4a5f-878a-3ce28425b991]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG os_brick.utils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:35 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updating existing volume attachment record: b047b4db-9c35-4342-a5d5-9ea386e1af0b {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:10:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:10:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [{"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-133d92d6-70ca-4d7e-90d1-4edd276e716f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTWfvLHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:44 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:44 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:44 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a95d3-b3a2-46ea-a43e-bde4de02ac52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:10:44 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da7b3a-ce2c-42fd-a73f-07debb349b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae] added
Aug 16 20:10:44 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f6b7a9-6e01-4235-aeb5-6a84fa1ff102]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6d440-5c72-4afd-bd92-25afec61a27e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTWfvLHE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTWfvLHE" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[103febf0-acdf-4e29-9ea1-2ace5380e283]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTWfvLHE'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144a885-1e0e-4af8-825f-c0b960e294c4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1ba07f-b3b6-41eb-a4f7-4ec14f0edf08]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e298c-2955-4374-a372-9cb39fc7284c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260]
Aug 16 20:10:45 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260] successful.
Aug 16 20:10:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292e27d-9310-413f-ad64-4525d5e72512]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216630.2237165, ffba17c7-da25-4759-9181-5a8732e7438d => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:10:45 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] VM Stopped (Lifecycle Event)
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411e857-4476-412a-b8b3-5128546b0401]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:45 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-577c39c8-8d59-418b-9b34-444286f463b6 None None] [instance: ffba17c7-da25-4759-9181-5a8732e7438d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe25a8d-407e-405a-9cce-503b49a6bd62]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTWfvLHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23131333161653938', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131333161653938', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:10:46 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:10:46 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:10:46 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:10:46 user nova-compute[72894]:   <serial>4a5ee702-d57d-49ee-a698-a05f32b150ae</serial>
Aug 16 20:10:46 user nova-compute[72894]: </disk>
Aug 16 20:10:46 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] No VIF found with MAC fa:16:3e:db:a3:2f, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:10:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=6829MB free_disk=24.205101013183594GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a84dfb53-db9f-4a63-b5e2-076336f99660 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.759s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 67838895-188d-42ea-9197-a9d8dc841ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e58319ae-a089-4b57-ad1b-922763b58293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 34d11735-e89e-4695-9ca5-d596a7b736b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:10:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVMCQGrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:48 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:48 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ff95d-7981-4d1b-ad26-222d68157ced]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:10:48 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6be076-eefb-4ce3-bb39-8be5668db219]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53] added
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[05beb04c-4f1a-475b-9e19-2a2bf6dca973]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaccfbf-951c-4c11-a90c-e0188220a21d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVMCQGrc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVMCQGrc" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16bfb01-ed29-4ae3-9e86-f0ad0777a41e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVMCQGrc'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e98cee4-b72c-4c07-a5d4-a535c11b3e6e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51dfc59-226c-456a-a510-a6389a549781]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1e0a5-2ed3-41f5-8e72-19ca8fbad8e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260]
Aug 16 20:10:48 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260] successful.
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3bfa4-bcac-43c3-a6e1-13ca09101501]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[17084102-6601-4990-8e5d-dc932454d82b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:48 user nova-compute[72894]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)
Aug 16 20:10:48 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2c754-f33e-4a9c-b70f-db25ad12b99a]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVMCQGrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:10:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23938363931396166', 'path': '/dev/sdf'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938363931396166', 'path': '/dev/sdf'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:10:49 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'flavor' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:10:49 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:10:49 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:10:49 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:10:49 user nova-compute[72894]:   <serial>d11661a9-9041-4a55-a63c-8d0387c1ce53</serial>
Aug 16 20:10:49 user nova-compute[72894]: </disk>
Aug 16 20:10:49 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:10:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No VIF found with MAC fa:16:3e:7e:e2:cb, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:10:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6039f54-3643-444b-847e-8f12a43657e5 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.704s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:51 user nova-compute[72894]: INFO nova.compute.manager [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Detaching volume d11661a9-9041-4a55-a63c-8d0387c1ce53
Aug 16 20:10:51 user nova-compute[72894]: INFO nova.virt.block_device [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Attempting to driver detach volume d11661a9-9041-4a55-a63c-8d0387c1ce53 from mountpoint /dev/vdb
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Attempting to detach device vdb from instance eee52fdd-dc11-4f58-9e51-483a6a771403 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:10:51 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:10:51 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:10:51 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:10:51 user nova-compute[72894]:   <serial>d11661a9-9041-4a55-a63c-8d0387c1ce53</serial>
Aug 16 20:10:51 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:10:51 user nova-compute[72894]: </disk>
Aug 16 20:10:51 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:10:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully detached device vdb from instance eee52fdd-dc11-4f58-9e51-483a6a771403 from the persistent domain config.
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eee52fdd-dc11-4f58-9e51-483a6a771403 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:10:51 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:10:51 user nova-compute[72894]:   <source dev="/dev/sdf"/>
Aug 16 20:10:51 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:10:51 user nova-compute[72894]:   <serial>d11661a9-9041-4a55-a63c-8d0387c1ce53</serial>
Aug 16 20:10:51 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:10:51 user nova-compute[72894]: </disk>
Aug 16 20:10:51 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216651.8568318, eee52fdd-dc11-4f58-9e51-483a6a771403 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:10:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully detached device vdb from instance eee52fdd-dc11-4f58-9e51-483a6a771403 from the live domain config.
Aug 16 20:10:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVMCQGrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:51 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3c048-792d-406e-b310-bdc9361384d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e3718a-248e-443e-b02f-39a07e94b602]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:51 user nova-compute[72894]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 (non-flash)
Aug 16 20:10:51 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c724550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53'): ({'sdf'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Removing single pathed devices sdf {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc94a072-4ad6-4622-aae5-944576d7621b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b35930-e0de-4ba5-837e-39be88882850]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Flushing IO for device /dev/sdf {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0dfe0b-c198-4761-8aeb-53af90574a0c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:10:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d65fc-6185-4b66-9a15-10b894cf81d6]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1f408-638b-41c5-962f-c9a7f94a2f27]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d50bb-ba9b-4b87-b8bf-2c9e0a1faf34]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260]
Aug 16 20:10:52 user nova-compute[72894]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53, portal: 172.16.0.220,3260] successful.
Aug 16 20:10:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d11661a9-9041-4a55-a63c-8d0387c1ce53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84326adb-26c9-458c-aa84-6e135698c4ec]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] <== disconnect_volume: return (342ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:10:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'flavor' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-efcd0b92-8b57-42f9-ae26-fb0af1384f81 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:55 user nova-compute[72894]: INFO nova.compute.manager [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Rescuing
Aug 16 20:10:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:56 user nova-compute[72894]: WARNING nova.compute.manager [req-3499e40d-92fc-4434-a23d-4ada71ec0e35 req-3a3460de-0208-4c3f-b747-a63400b2b58a service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state rescuing.
Aug 16 20:10:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance destroyed successfully.
Aug 16 20:10:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Attempting a stable device rescue
Aug 16 20:10:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:10:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Creating image(s)
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.part --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:57 user nova-compute[72894]: DEBUG nova.virt.images [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] c3d6c18a-2084-4a37-a58a-a509e43c4081 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:10:57 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:10:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.part /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:10:58 user nova-compute[72894]: WARNING nova.compute.manager [req-60c1ec4a-d341-4d31-b2c5-b8776a4d5bde req-1a2e0aa4-7ef6-4454-a265-5f73546e1099 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state rescuing.
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.part /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.converted" returned: 0 in 0.685s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.208s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6 --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6,backing_fmt=raw /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6,backing_fmt=raw /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue" returned: 0 in 0.058s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "ecc7796acae77b0c5bb2a9e6e96d5959bba271a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'migration_context' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start _get_guest_xml network_info=[{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:b9:b7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c3d6c18a-2084-4a37-a58a-a509e43c4081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ad239274-93fd-440f-9adb-75cb8d080e2c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9e018532-ae8e-4b6f-9931-18a006bdfc78', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8cb30a6-f3be-4a0a-94a4-c544dd233d06', 'serial': 'f8cb30a6-f3be-4a0a-94a4-c544dd233d06'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:10:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:10:59 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8cce8-8aa6-45f1-84f2-67b6d7654b65]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ksSpUXEO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 20:10:59 user nova-compute[72894]: node.name = iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06
Aug 16 20:10:59 user nova-compute[72894]: node.tpgt = -1
Aug 16 20:10:59 user nova-compute[72894]: node.startup = automatic
Aug 16 20:10:59 user nova-compute[72894]: node.leading_login = No
Aug 16 20:10:59 user nova-compute[72894]: iface.iscsi_ifacename = default
Aug 16 20:10:59 user nova-compute[72894]: iface.net_ifacename = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.ipaddress = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.prefix_len = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.hwaddress = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.transport_name = tcp
Aug 16 20:10:59 user nova-compute[72894]: iface.initiatorname = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.vlan_id = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.vlan_priority = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.vlan_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.iface_num = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.mtu = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.port = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.bootproto = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.subnet_mask = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.gateway = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_alt_client_id = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_dns = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_learn_iqn = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_vendor_id_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_vendor_id = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.dhcp_slp_da = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.fragmentation = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.gratuitous_arp = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.incoming_forwarding = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.tos_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.tos = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.ttl = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.delayed_ack = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.tcp_nagle = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.tcp_wsf_state = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.tcp_wsf = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.tcp_timer_scale = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.tcp_timestamp = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.redirect = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.def_task_mgmt_timeout = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.header_digest = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.data_digest = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.immediate_data = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.initial_r2t = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.data_seq_inorder = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.data_pdu_inorder = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.erl = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.max_receive_data_len = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.first_burst_len = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.max_outstanding_r2t = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.max_burst_len = 0
Aug 16 20:10:59 user nova-compute[72894]: iface.chap_auth = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.bidi_chap = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.strict_login_compliance = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.discovery_auth = <empty>
Aug 16 20:10:59 user nova-compute[72894]: iface.discovery_logout = <empty>
Aug 16 20:10:59 user nova-compute[72894]: node.discovery_address = <empty>
Aug 16 20:10:59 user nova-compute[72894]: node.discovery_port = 0
Aug 16 20:10:59 user nova-compute[72894]: node.discovery_type = static
Aug 16 20:10:59 user nova-compute[72894]: node.session.initial_cmdsn = 0
Aug 16 20:10:59 user nova-compute[72894]: node.session.initial_login_retry_max = 8
Aug 16 20:10:59 user nova-compute[72894]: node.session.xmit_thread_priority = -20
Aug 16 20:10:59 user nova-compute[72894]: node.session.cmds_max = 128
Aug 16 20:10:59 user nova-compute[72894]: node.session.queue_depth = 32
Aug 16 20:10:59 user nova-compute[72894]: node.session.nr_sessions = 1
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.authmethod = CHAP
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.username = ksSpUXEO
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.password = ***
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.username_in = <empty>
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.password_in = <empty>
Aug 16 20:10:59 user nova-compute[72894]: node.session.auth.chap_algs = MD5
Aug 16 20:10:59 user nova-compute[72894]: node.session.timeo.replacement_timeout = 120
Aug 16 20:10:59 user nova-compute[72894]: node.session.err_timeo.abort_timeout = 15
Aug 16 20:10:59 user nova-compute[72894]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 20:10:59 user nova-compute[72894]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 20:10:59 user nova-compute[72894]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.FastAbort = Yes
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.InitialR2T = No
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.ImmediateData = Yes
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.MaxConnections = 1
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 20:10:59 user nova-compute[72894]: node.session.iscsi.ERL = 0
Aug 16 20:10:59 user nova-compute[72894]: node.session.scan = manual
Aug 16 20:10:59 user nova-compute[72894]: node.session.reopen_max = 0
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].address = 172.16.0.220
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].port = 3260
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].startup = manual
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].tcp.window_size = 524288
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].tcp.type_of_service = 0
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].timeo.logout_timeout = 15
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].timeo.login_timeout = 15
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].timeo.auth_timeout = 45
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.DataDigest = None
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.IFMarker = No
Aug 16 20:10:59 user nova-compute[72894]: node.conn[0].iscsi.OFMarker = No
Aug 16 20:10:59 user nova-compute[72894]: # END RECORD
Aug 16 20:10:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[524806cf-38f3-4a04-b1f2-d88a451f1338]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbfa9e4-a3d3-4d5a-96b5-53faf851003c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksSpUXEO {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksSpUXEO" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e9e589-e5a3-40b4-a44b-5dbf8af7113b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksSpUXEO'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[088c9d74-4ccb-4f3c-a02e-c8c307ca7836]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0a752-b21f-45a1-8017-0c885ad7abf2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:10:59 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:10:59 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a97f87-e686-4dd5-b3d5-ccbf0ef08950]: (4, ('0 0 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23136313330613964', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136313330613964', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461249139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461249139',id=26,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-kblycte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:09:34Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=9e018532-ae8e-4b6f-9931-18a006bdfc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:b9:b7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "vif_mac": "fa:16:3e:b9:b7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:10:59 user nova-compute[72894]:   <uuid>9e018532-ae8e-4b6f-9931-18a006bdfc78</uuid>
Aug 16 20:10:59 user nova-compute[72894]:   <name>instance-0000001a</name>
Aug 16 20:10:59 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:10:59 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:10:59 user nova-compute[72894]:   <metadata>
Aug 16 20:10:59 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:10:59 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1461249139</nova:name>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:10:59</nova:creationTime>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:10:59 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:10:59 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:owner>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:user uuid="5c9bdeca6ea84622835b26c7565f148c">tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member</nova:user>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:project uuid="0853a75dd30c499288bb5e848f038580">tempest-ServerBootFromVolumeStableRescueTest-1302332523</nova:project>
Aug 16 20:10:59 user nova-compute[72894]:       </nova:owner>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:10:59 user nova-compute[72894]:       <nova:ports>
Aug 16 20:10:59 user nova-compute[72894]:         <nova:port uuid="3c3b2f52-b6a1-44d7-9f39-c9419db01724">
Aug 16 20:10:59 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:10:59 user nova-compute[72894]:         </nova:port>
Aug 16 20:10:59 user nova-compute[72894]:       </nova:ports>
Aug 16 20:10:59 user nova-compute[72894]:     </nova:instance>
Aug 16 20:10:59 user nova-compute[72894]:   </metadata>
Aug 16 20:10:59 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:10:59 user nova-compute[72894]:     <system>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="serial">9e018532-ae8e-4b6f-9931-18a006bdfc78</entry>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="uuid">9e018532-ae8e-4b6f-9931-18a006bdfc78</entry>
Aug 16 20:10:59 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:10:59 user nova-compute[72894]:     </system>
Aug 16 20:10:59 user nova-compute[72894]:   </sysinfo>
Aug 16 20:10:59 user nova-compute[72894]:   <os>
Aug 16 20:10:59 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:10:59 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:10:59 user nova-compute[72894]:   </os>
Aug 16 20:10:59 user nova-compute[72894]:   <features>
Aug 16 20:10:59 user nova-compute[72894]:     <acpi/>
Aug 16 20:10:59 user nova-compute[72894]:     <apic/>
Aug 16 20:10:59 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:10:59 user nova-compute[72894]:   </features>
Aug 16 20:10:59 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:10:59 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:10:59 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:10:59 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:10:59 user nova-compute[72894]:   </clock>
Aug 16 20:10:59 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:10:59 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:10:59 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:10:59 user nova-compute[72894]:   </cpu>
Aug 16 20:10:59 user nova-compute[72894]:   <devices>
Aug 16 20:10:59 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:10:59 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:10:59 user nova-compute[72894]:       <source dev="/dev/sdd"/>
Aug 16 20:10:59 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:10:59 user nova-compute[72894]:       <serial>f8cb30a6-f3be-4a0a-94a4-c544dd233d06</serial>
Aug 16 20:10:59 user nova-compute[72894]:     </disk>
Aug 16 20:10:59 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:10:59 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:10:59 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue"/>
Aug 16 20:10:59 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:10:59 user nova-compute[72894]:       <boot order="1"/>
Aug 16 20:10:59 user nova-compute[72894]:     </disk>
Aug 16 20:10:59 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:10:59 user nova-compute[72894]:       <mac address="fa:16:3e:b9:b7:b9"/>
Aug 16 20:10:59 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:59 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:10:59 user nova-compute[72894]:       <target dev="tap3c3b2f52-b6"/>
Aug 16 20:10:59 user nova-compute[72894]:     </interface>
Aug 16 20:10:59 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:10:59 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/console.log" append="off"/>
Aug 16 20:10:59 user nova-compute[72894]:     </serial>
Aug 16 20:10:59 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:10:59 user nova-compute[72894]:     <video>
Aug 16 20:10:59 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:10:59 user nova-compute[72894]:     </video>
Aug 16 20:10:59 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:10:59 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:10:59 user nova-compute[72894]:     </rng>
Aug 16 20:10:59 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:10:59 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:10:59 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:10:59 user nova-compute[72894]:     </memballoon>
Aug 16 20:10:59 user nova-compute[72894]:   </devices>
Aug 16 20:10:59 user nova-compute[72894]: </domain>
Aug 16 20:10:59 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:10:59 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance destroyed successfully.
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:10:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] No VIF found with MAC fa:16:3e:b9:b7:b9, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:11:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:01 user nova-compute[72894]: WARNING nova.compute.manager [req-5e3af054-4d48-415c-bba3-0a1362e6fed0 req-bf0f71e4-6c7e-400e-b7b5-8e40a0490cd2 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state rescuing.
Aug 16 20:11:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 9e018532-ae8e-4b6f-9931-18a006bdfc78 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:11:02 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216662.9839478, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:02 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Resumed (Lifecycle Event)
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bd79bc75-6dbe-4c1e-a6b5-fde7369513c1 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216662.9883075, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Started (Lifecycle Event)
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:03 user nova-compute[72894]: WARNING nova.compute.manager [req-d3d1f0ce-def5-4bb0-8a3e-2b53b551ce07 req-60f2e7f3-114a-4210-a147-8776509b61e5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state rescued and task_state None.
Aug 16 20:11:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing instance network info cache due to event network-changed-f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Refreshing network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:11:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated VIF entry in instance network info cache for port f3449faa-4fc8-45a8-ab01-92e456d1eda7. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:11:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ea5a9de2-6836-416a-8c44-d196b1bc271f req-ff8891fb-cd65-491a-bcc2-9a63e62a34d8 service nova] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Stashing vm_state: active {{(pid=72894) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:11:12 user nova-compute[72894]: INFO nova.compute.claims [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Claim successful on node user
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'resources' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:12 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating resource usage from migration dbb5b215-133d-43df-8997-40186d9807ab
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.509s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:12 user nova-compute[72894]: INFO nova.compute.manager [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Migrating
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-changed-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Refreshing instance network info cache due to event network-changed-41a97b77-d117-472e-8d2b-524454350c6b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Refreshing network info cache for port 41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:11:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updated VIF entry in instance network info cache for port 41a97b77-d117-472e-8d2b-524454350c6b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9b0234b3-a1f7-42ee-9dd0-70e77db80136 req-1444bc1f-e29d-4da7-9c8a-27f303cbeecb service nova] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Starting migrate_disk_and_power_off {{(pid=72894) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance destroyed successfully.
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41a97b77-d1, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:11:14 user nova-compute[72894]: INFO os_vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1')
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f31afe-df68-416c-8cf0-ce4d86d53831]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b50c9b-c207-4bdf-a92a-6836dbdb0b2d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:11:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:14 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:11:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79907470a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[de978bb6-bdc8-4791-815b-eb1aaab84c89]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc258de-f9e0-42ca-9f19-b53f67956462]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e8ce6-7a04-4771-b1fa-8095f4509ae5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:14 user nova-compute[72894]: WARNING nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state resize_migrating.
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:14 user nova-compute[72894]: WARNING nova.compute.manager [req-899d6ba1-e2ae-4a0b-84c0-a2e2c1c92e89 req-9ff1dd83-47d5-48d5-9c32-34a5f47304ac service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state resize_migrating.
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8b94c-b346-445d-88f7-d2fff0158418]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccd5c994', '/dev/disk/by-id/scsi-1SCST_BIOccd5c994-0eda0d0bc5257245', '/dev/disk/by-id/scsi-23065646130643062') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b85bc-6915-4a6b-92de-4c87e4ff97e1]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9d1bb-ad9f-4cdd-b3b7-f76d972bfe3a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770f834-e530-4a3a-9a79-001ca1159c71]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]
Aug 16 20:11:14 user nova-compute[72894]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.
Aug 16 20:11:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e066a8e-aa37-40eb-8eba-65cde375b246]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== disconnect_volume: return (411ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:11:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Port 41a97b77-d117-472e-8d2b-524454350c6b binding to destination host user is already ACTIVE {{(pid=72894) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG os_brick.utils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd82a2-ba82-4327-99f4-9a931c4a7e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6a821-3a63-482c-aff7-d1ce8df9f128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edb049-0447-455a-9cb4-b1eec7e1bdd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[72933be1-71b4-4f47-930e-e597f8c90e07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:17 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:11:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c9b59-7175-4df3-92b1-01b1c73c22c5]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:11:17 user nova-compute[72894]: DEBUG os_brick.utils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:24 user nova-compute[72894]: INFO nova.compute.manager [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Detaching volume 4a5ee702-d57d-49ee-a698-a05f32b150ae
Aug 16 20:11:24 user nova-compute[72894]: INFO nova.virt.block_device [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Attempting to driver detach volume 4a5ee702-d57d-49ee-a698-a05f32b150ae from mountpoint /dev/vdb
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Attempting to detach device vdb from instance e58319ae-a089-4b57-ad1b-922763b58293 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:11:24 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:11:24 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:11:24 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:11:24 user nova-compute[72894]:   <serial>4a5ee702-d57d-49ee-a698-a05f32b150ae</serial>
Aug 16 20:11:24 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:11:24 user nova-compute[72894]: </disk>
Aug 16 20:11:24 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:11:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully detached device vdb from instance e58319ae-a089-4b57-ad1b-922763b58293 from the persistent domain config.
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e58319ae-a089-4b57-ad1b-922763b58293 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:11:24 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:11:24 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:11:24 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:11:24 user nova-compute[72894]:   <serial>4a5ee702-d57d-49ee-a698-a05f32b150ae</serial>
Aug 16 20:11:24 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:11:24 user nova-compute[72894]: </disk>
Aug 16 20:11:24 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216684.587549, e58319ae-a089-4b57-ad1b-922763b58293 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:11:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully detached device vdb from instance e58319ae-a089-4b57-ad1b-922763b58293 from the live domain config.
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTWfvLHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:24 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf67bc-ff33-47e7-8383-426fcbeb1be8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[101918f7-b16e-48f8-822e-a307f4d64c94]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:11:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:24 user nova-compute[72894]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae (non-flash)
Aug 16 20:11:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c697520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963a3bf-acb4-418b-a4e0-69a095a66755]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510b31e-c0be-48d5-bada-395b8fa1cb28]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a41dd5-b846-4934-938d-4c4efaf2caea]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1938cb56-a969-4b0d-8786-098e084c5689]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea9fb9-9fde-4c5b-b29d-f6293efc9493]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d03a8-16fa-4cda-aae4-0331d204b94c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260]
Aug 16 20:11:24 user nova-compute[72894]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae, portal: 172.16.0.220,3260] successful.
Aug 16 20:11:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2445c-668e-44b9-8035-58537a8e911c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== disconnect_volume: return (320ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'flavor' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-586f8d2e-a93b-435c-b080-0601974e3f60 tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.636s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:25 user nova-compute[72894]: INFO nova.compute.manager [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Terminating instance
Aug 16 20:11:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:25 user nova-compute[72894]: INFO nova.compute.manager [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Terminating instance
Aug 16 20:11:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-unplugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] No waiting events found dispatching network-vif-unplugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-ce689753-7129-443a-b146-aba30f4decdb req-7375af67-ad02-4b62-8a4c-23767b9a45ad service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-unplugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-96bb8491-f53e-4884-9c86-5029577451c0 req-8f403f8e-fea2-44cb-922e-2ddb2dbff478 service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Instance destroyed successfully.
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid 67838895-188d-42ea-9197-a9d8dc841ae5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929888821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929888821',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7mFn0LcVbWpuX1GVAHCAfJn2BkbWDm8cUL/VEhYSFDFzlKR60tA3i7gZmj0/D8lHdipPXA3g2yZM3pzBmzkH2bYKiJ+20Mx03/YjRca1gzqmrnrYmQgMRkRDgwENF2Ig==',key_name='tempest-keypair-2071324434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:06:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-sg0l0pfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b7460311d94421a6015c08fa900e6c',uuid=67838895-188d-42ea-9197-a9d8dc841ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "address": "fa:16:3e:dd:f7:39", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f99dea-36", "ovs_interfaceid": "b6f99dea-3695-4b5b-a3b1-52a58e4e4741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_vif [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6f99dea-36, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: INFO os_vif [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=b6f99dea-3695-4b5b-a3b1-52a58e4e4741,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f99dea-36')
Aug 16 20:11:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Instance destroyed successfully.
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lazy-loading 'resources' on Instance uuid e58319ae-a089-4b57-ad1b-922763b58293 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZJHwrpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-573217987',display_name='tempest-VolumesSnapshotTestJSON-instance-573217987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-573217987',id=25,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUfeF5d4rJfh0mTvDkwuIACEiZAe8uHq5TCFV+Wo9xAnqRPVsEZETwNClb9PuFmE0qiq4MznpdlAw+BiUDHMjcmtCtG104l1CpoJygqg6rAH5Tt6txvzA7Dafb22s+Y3g==',key_name='tempest-keypair-448632896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:08:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b407241100354a8a97202de4aae0e75c',ramdisk_id='',reservation_id='r-3flvb0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-762102976',owner_user_name='tempest-VolumesSnapshotTestJSON-762102976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c230d020ad34a1588a93fd4a010750c',uuid=e58319ae-a089-4b57-ad1b-922763b58293,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converting VIF {"id": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "address": "fa:16:3e:db:a3:2f", "network": {"id": "33e025c7-1947-4d16-a76d-ba2477f4ce61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-54982393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b407241100354a8a97202de4aae0e75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6239d484-f4", "ovs_interfaceid": "6239d484-f4a5-45cc-8ebf-19d2291c1bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_vif [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6239d484-f4, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: INFO os_vif [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=6239d484-f4a5-45cc-8ebf-19d2291c1bcf,network=Network(33e025c7-1947-4d16-a76d-ba2477f4ce61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6239d484-f4')
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225baf7-4a9f-4fe8-9700-357848980acc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTWfvLHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b971b1-978a-4095-86c8-c8429dc6e87a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799066cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[373cac69-a8a9-449a-b186-b4dfad3e6ddf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f8dc1b-2cd6-4f5f-b9ae-c58aafdfc0c5]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e50f3f-ed8d-47c1-bafb-2542b2e00168]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4240848-e5aa-44e8-b440-bd0f51afecc7]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8b5bec4-dbed4ae6a1d310db', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b5bec4', '/dev/disk/by-id/scsi-26462656434616536') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:11:27 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8b5bec4-dbed4ae6a1d310db
Aug 16 20:11:27 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8b5bec4
Aug 16 20:11:27 user nova-compute[72894]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26462656434616536
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd7890a-c466-4c22-a14a-f801da9729a0]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5140b410-ef80-426a-bb0d-eb4075c3df66]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d613731-a310-4aa8-90e6-ef6de3794777]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260]
Aug 16 20:11:27 user nova-compute[72894]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562, portal: 172.16.0.220,3260] successful.
Aug 16 20:11:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4b66c2b-4ec6-40d5-9aba-827d0e43e562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f7ba6-d51f-4823-8141-34d936c3b04f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (332ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Deleting instance files /opt/stack/data/nova/instances/67838895-188d-42ea-9197-a9d8dc841ae5_del
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Deletion of /opt/stack/data/nova/instances/67838895-188d-42ea-9197-a9d8dc841ae5_del complete
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.302s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5ee702-d57d-49ee-a698-a05f32b150ae', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d13361e-0a6f-4096-8286-92fcfa039f33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[73088050-218b-4b56-94a9-6c607f268e2e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:27 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:27 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:27 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799055f2e0>, {}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Disconnecting from: [] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] <== disconnect_volume: return (360ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Deleting instance files /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293_del
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Deletion of /opt/stack/data/nova/instances/e58319ae-a089-4b57-ad1b-922763b58293_del complete
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.compute.manager [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:11:27 user nova-compute[72894]: INFO nova.compute.manager [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 16 20:11:27 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] Acquiring lock "e58319ae-a089-4b57-ad1b-922763b58293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] Lock "e58319ae-a089-4b57-ad1b-922763b58293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] No waiting events found dispatching network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.compute.manager [req-e84f2ae2-84d6-4e19-bde0-76216ebaf41c req-00f0c92f-29f6-4ea5-9ec4-4351592a7338 service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received unexpected event network-vif-plugged-6239d484-f4a5-45cc-8ebf-19d2291c1bcf for instance with vm_state active and task_state deleting.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state active and task_state deleting.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state active and task_state deleting.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.compute.manager [req-8f4cef7d-e657-4a3b-9768-248f6dc799ff req-5c38102a-5347-431c-b264-9456bf5ca63d service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state active and task_state deleting.
Aug 16 20:11:28 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Took 0.95 seconds to deallocate network for instance.
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.volume.cinder [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Attachment 3c0a2a6c-c568-4356-8bfe-2fd9a40053aa does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c0a2a6c-c568-4356-8bfe-2fd9a40053aa. (HTTP 404) (Request-ID: req-6546f975-4735-4b8f-b0a1-9a0a40ed0b96)
Aug 16 20:11:28 user nova-compute[72894]: INFO nova.compute.manager [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Starting finish_migration {{(pid=72894) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:11:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Creating image(s)
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Ensure instance console log exists: /opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start _get_guest_xml network_info=[{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'aea1a14a-99f7-4c7d-9181-74dd4a4207e3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f4bb0f9-a9ca-4bde-ae50-fd20e768d355', 'attached_at': '2023-08-16T20:11:28.000000', 'detached_at': '', 'volume_id': 'b2886717-52f0-4bd3-b46d-2b0c7996cbfc', 'serial': 'b2886717-52f0-4bd3-b46d-2b0c7996cbfc'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:28 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f20bae1-45b6-46c6-8084-c9f7cc0ca5d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:11:28 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2e198-95e3-40df-b6f1-1642b0e313e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc] added
Aug 16 20:11:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166f4ae-a91e-4531-b8b7-70aa9ec3e9c8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304223b-7431-4c7b-b96a-bc5ea127760c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfiNrAxy {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Took 1.52 seconds to deallocate network for instance.
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfiNrAxy" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414d28e-6cbe-45bd-ae6f-9f1e6ca489f6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfiNrAxy'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c2b9d-4c26-4a8a-b273-424fec83d77f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6992ee3-ef8e-4772-a440-00ee5cc9630a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:28 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:28 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:28 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Deleted allocations for instance e58319ae-a089-4b57-ad1b-922763b58293
Aug 16 20:11:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-78ad0e12-44e8-4015-8ab6-941658dd7a1a tempest-VolumesSnapshotTestJSON-762102976 tempest-VolumesSnapshotTestJSON-762102976-project-member] Lock "e58319ae-a089-4b57-ad1b-922763b58293" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.270s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216674.5234663, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:29 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Stopped (Lifecycle Event)
Aug 16 20:11:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b3a703df-05d1-49d5-8454-fba94053d9fe None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b3a703df-05d1-49d5-8454-fba94053d9fe None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:29 user nova-compute[72894]: INFO nova.compute.manager [None req-b3a703df-05d1-49d5-8454-fba94053d9fe None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:11:29 user nova-compute[72894]: INFO nova.compute.manager [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 20:11:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Deleting volume: c4b66c2b-4ec6-40d5-9aba-827d0e43e562 {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80eef4-4960-48e1-8e44-bfc966a9531c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]
Aug 16 20:11:29 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.
Aug 16 20:11:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[81420dea-70d4-4772-88ff-ed6408ddd33a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d73c753-ce0d-4d53-8542-4dd4bd2166a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:30 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:30 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:30 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:30 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.307s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e59cd-26cf-4a5f-9bb5-dcd43d75e777]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-e282087b-bb5c-4435-ba8d-fa3cd55c1c5a req-7e171a87-c3ab-4078-8c6e-e26907f3c49c service nova] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Received event network-vif-deleted-6239d484-f4a5-45cc-8ebf-19d2291c1bcf {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:30 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance 67838895-188d-42ea-9197-a9d8dc841ae5
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-eb9355b7-2b79-4fb4-b8c5-c17758dad164 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "67838895-188d-42ea-9197-a9d8dc841ae5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.453s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:30 user nova-compute[72894]: WARNING nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-unplugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state deleted and task_state None.
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Acquiring lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] Lock "67838895-188d-42ea-9197-a9d8dc841ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] No waiting events found dispatching network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:30 user nova-compute[72894]: WARNING nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received unexpected event network-vif-plugged-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 for instance with vm_state deleted and task_state None.
Aug 16 20:11:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-23bb8ecf-f3eb-4f97-97de-f9adbc015ad3 req-a808f158-3986-4f78-8e95-a4d28ecbeaaa service nova] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Received event network-vif-deleted-b6f99dea-3695-4b5b-a3b1-52a58e4e4741 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.342s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== connect_volume: return (2343ms) {'type': 'block', 'scsi_wwn': '23065646130643062', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065646130643062', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:11:31 user nova-compute[72894]:   <uuid>4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</uuid>
Aug 16 20:11:31 user nova-compute[72894]:   <name>instance-0000001b</name>
Aug 16 20:11:31 user nova-compute[72894]:   <memory>2097152</memory>
Aug 16 20:11:31 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:11:31 user nova-compute[72894]:   <metadata>
Aug 16 20:11:31 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:11:31 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:11:31 user nova-compute[72894]:       <nova:name>tempest-ServerActionsTestOtherA-server-962766217</nova:name>
Aug 16 20:11:31 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:11:28</nova:creationTime>
Aug 16 20:11:31 user nova-compute[72894]:       <nova:flavor name="m1.small">
Aug 16 20:11:31 user nova-compute[72894]:         <nova:memory>2048</nova:memory>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:disk>20</nova:disk>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:11:31 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:11:31 user nova-compute[72894]:       <nova:owner>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:user uuid="6787ebe74f6445caa43d44813f58ab21">tempest-ServerActionsTestOtherA-2019589976-project-member</nova:user>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:project uuid="0d388dc7ba4643d198d2999ec1f87afe">tempest-ServerActionsTestOtherA-2019589976</nova:project>
Aug 16 20:11:31 user nova-compute[72894]:       </nova:owner>
Aug 16 20:11:31 user nova-compute[72894]:       <nova:ports>
Aug 16 20:11:31 user nova-compute[72894]:         <nova:port uuid="41a97b77-d117-472e-8d2b-524454350c6b">
Aug 16 20:11:31 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:11:31 user nova-compute[72894]:         </nova:port>
Aug 16 20:11:31 user nova-compute[72894]:       </nova:ports>
Aug 16 20:11:31 user nova-compute[72894]:     </nova:instance>
Aug 16 20:11:31 user nova-compute[72894]:   </metadata>
Aug 16 20:11:31 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:11:31 user nova-compute[72894]:     <system>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="serial">4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</entry>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="uuid">4f4bb0f9-a9ca-4bde-ae50-fd20e768d355</entry>
Aug 16 20:11:31 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:11:31 user nova-compute[72894]:     </system>
Aug 16 20:11:31 user nova-compute[72894]:   </sysinfo>
Aug 16 20:11:31 user nova-compute[72894]:   <os>
Aug 16 20:11:31 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:11:31 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:11:31 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:11:31 user nova-compute[72894]:   </os>
Aug 16 20:11:31 user nova-compute[72894]:   <features>
Aug 16 20:11:31 user nova-compute[72894]:     <acpi/>
Aug 16 20:11:31 user nova-compute[72894]:     <apic/>
Aug 16 20:11:31 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:11:31 user nova-compute[72894]:   </features>
Aug 16 20:11:31 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:11:31 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:11:31 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:11:31 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:11:31 user nova-compute[72894]:   </clock>
Aug 16 20:11:31 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:11:31 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:11:31 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:11:31 user nova-compute[72894]:   </cpu>
Aug 16 20:11:31 user nova-compute[72894]:   <devices>
Aug 16 20:11:31 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:11:31 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:11:31 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:11:31 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:11:31 user nova-compute[72894]:       <serial>b2886717-52f0-4bd3-b46d-2b0c7996cbfc</serial>
Aug 16 20:11:31 user nova-compute[72894]:     </disk>
Aug 16 20:11:31 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:11:31 user nova-compute[72894]:       <mac address="fa:16:3e:cb:2f:e1"/>
Aug 16 20:11:31 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:11:31 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:11:31 user nova-compute[72894]:       <target dev="tap41a97b77-d1"/>
Aug 16 20:11:31 user nova-compute[72894]:     </interface>
Aug 16 20:11:31 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:11:31 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355/console.log" append="off"/>
Aug 16 20:11:31 user nova-compute[72894]:     </serial>
Aug 16 20:11:31 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:11:31 user nova-compute[72894]:     <video>
Aug 16 20:11:31 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:11:31 user nova-compute[72894]:     </video>
Aug 16 20:11:31 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:11:31 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:11:31 user nova-compute[72894]:     </rng>
Aug 16 20:11:31 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:11:31 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:11:31 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:11:31 user nova-compute[72894]:     </memballoon>
Aug 16 20:11:31 user nova-compute[72894]:   </devices>
Aug 16 20:11:31 user nova-compute[72894]: </domain>
Aug 16 20:11:31 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2089435226-network", "vif_mac": "fa:16:3e:cb:2f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG os_vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41a97b77-d1, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41a97b77-d1, col_values=(('external_ids', {'iface-id': '41a97b77-d117-472e-8d2b-524454350c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2f:e1', 'vm-uuid': '4f4bb0f9-a9ca-4bde-ae50-fd20e768d355'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:31 user nova-compute[72894]: INFO os_vif [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1')
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:11:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] No VIF found with MAC fa:16:3e:cb:2f:e1, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-changed-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Refreshing instance network info cache due to event network-changed-eefb938d-3ca8-424e-aa08-c4139d8cd81c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] Acquiring lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] Acquired lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Refreshing network info cache for port eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updated VIF entry in instance network info cache for port eefb938d-3ca8-424e-aa08-c4139d8cd81c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating instance_info_cache with network_info: [{"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0c5cac0-b546-4735-a3e6-eb3a5ebc11e5 req-ca19772c-64a0-4200-a94f-c937f9591cdf service nova] Releasing lock "refresh_cache-cef80969-a51d-46a1-a5b1-d510ecb97f81" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:33 user nova-compute[72894]: INFO nova.compute.manager [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attaching volume 9085192a-bc32-4bf9-afbb-1a198e59793a to /dev/vdb
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[204993c0-07b9-4597-bc45-a0c1bbd9d4ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67c0ca2-d5e8-4d93-a47f-9d99c1086982]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddb2fe-241a-4ff6-b48b-3d0bc02dc14d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[496f249d-1a82-48e0-8715-a85e8ffee6f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:33 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:11:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01a77b-5005-40ed-a805-9c29daecdaa9]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating existing volume attachment record: 3e369761-fb83-46fe-90cc-8b5700fa6480 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:11:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:34 user nova-compute[72894]: WARNING nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state resize_finish.
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:34 user nova-compute[72894]: WARNING nova.compute.manager [req-db6153c7-faba-4f5e-81f0-424f9b7436c1 req-64a574af-45a7-439b-929a-adc7750a341b service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state resize_finish.
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216694.6315386, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Resumed (Lifecycle Event)
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:11:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance running successfully.
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Failed to set time: agent not configured {{(pid=72894) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ad5aa032-b021-4709-ab77-c712e98d4573 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] finish_migration finished successfully. {{(pid=72894) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216694.6336226, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Started (Lifecycle Event)
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 20:11:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216686.7898157, 67838895-188d-42ea-9197-a9d8dc841ae5 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] VM Stopped (Lifecycle Event)
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d759aaae-d066-495e-9c8d-7317fdb22fbd None None] [instance: 67838895-188d-42ea-9197-a9d8dc841ae5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216686.8455417, e58319ae-a089-4b57-ad1b-922763b58293 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e58319ae-a089-4b57-ad1b-922763b58293] VM Stopped (Lifecycle Event)
Aug 16 20:11:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d6021383-1801-44c0-b6b2-e17cf3c70c95 None None] [instance: e58319ae-a089-4b57-ad1b-922763b58293] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:11:42 user nova-compute[72894]: INFO nova.compute.claims [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Claim successful on node user
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:11:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:11:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.policy [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7b74284f2c24d79bc01434de253ae70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564438a58fc64bf2b60d95f4c3eb0fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:11:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Creating image(s)
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "/opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "/opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk 1073741824" returned: 0 in 0.096s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Successfully created port: 1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Cannot resize image /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'migration_context' on Instance uuid 7f29e2f8-0a16-42e9-9aae-364d429228aa {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Ensure instance console log exists: /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWmHtQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:11:45 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Successfully updated port: 1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquired lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0aa67a-44bc-4274-9998-1f1a67373fe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:11:45 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1325f72-3141-4883-8c15-688d973c1c01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a] added
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-changed-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Refreshing instance network info cache due to event network-changed-1b7defbc-19e0-48eb-ae49-00a7deecc110. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] Acquiring lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50305d5-0163-46b6-9f91-2c1707b92d63]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c20d57-d768-4bfb-9dd2-cbde1caa299e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puWmHtQS {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puWmHtQS" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6cb50-df3b-4832-af81-26cb52960461]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puWmHtQS'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb56566-66fa-4d4d-9ba0-617b35084dc3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ee5f6a-dde3-49bd-92a7-ab714fce858a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52ff34-9409-4ecd-8c0a-3b44b43a0cc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260]
Aug 16 20:11:45 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260] successful.
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b762b-f507-4cfc-be27-d5a5ebe78d9e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3b9e75-c3cb-4953-a52a-470fbd251de9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:11:45 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:11:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9228c07e-66b7-4b0a-b8b5-8a503eddc6e8]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWmHtQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Updating instance_info_cache with network_info: [{"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Releasing lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Instance network_info: |[{"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] Acquired lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Refreshing network info cache for port 1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Start _get_guest_xml network_info=[{"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:11:45 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:45 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1763343589',display_name='tempest-VolumesAdminNegativeTest-server-1763343589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1763343589',id=31,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-uo30cqjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:11:44Z,user_data=None,user_id='d7b74284f2c24d79bc01434de253ae70',uuid=7f29e2f8-0a16-42e9-9aae-364d429228aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG nova.objects.instance [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f29e2f8-0a16-42e9-9aae-364d429228aa {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:11:46 user nova-compute[72894]:   <uuid>7f29e2f8-0a16-42e9-9aae-364d429228aa</uuid>
Aug 16 20:11:46 user nova-compute[72894]:   <name>instance-0000001f</name>
Aug 16 20:11:46 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:11:46 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:11:46 user nova-compute[72894]:   <metadata>
Aug 16 20:11:46 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:11:46 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1763343589</nova:name>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:11:45</nova:creationTime>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:11:46 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:11:46 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:owner>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:user uuid="d7b74284f2c24d79bc01434de253ae70">tempest-VolumesAdminNegativeTest-1980072019-project-member</nova:user>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:project uuid="564438a58fc64bf2b60d95f4c3eb0fe8">tempest-VolumesAdminNegativeTest-1980072019</nova:project>
Aug 16 20:11:46 user nova-compute[72894]:       </nova:owner>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:11:46 user nova-compute[72894]:       <nova:ports>
Aug 16 20:11:46 user nova-compute[72894]:         <nova:port uuid="1b7defbc-19e0-48eb-ae49-00a7deecc110">
Aug 16 20:11:46 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:11:46 user nova-compute[72894]:         </nova:port>
Aug 16 20:11:46 user nova-compute[72894]:       </nova:ports>
Aug 16 20:11:46 user nova-compute[72894]:     </nova:instance>
Aug 16 20:11:46 user nova-compute[72894]:   </metadata>
Aug 16 20:11:46 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:11:46 user nova-compute[72894]:     <system>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="serial">7f29e2f8-0a16-42e9-9aae-364d429228aa</entry>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="uuid">7f29e2f8-0a16-42e9-9aae-364d429228aa</entry>
Aug 16 20:11:46 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:11:46 user nova-compute[72894]:     </system>
Aug 16 20:11:46 user nova-compute[72894]:   </sysinfo>
Aug 16 20:11:46 user nova-compute[72894]:   <os>
Aug 16 20:11:46 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:11:46 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:11:46 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:11:46 user nova-compute[72894]:   </os>
Aug 16 20:11:46 user nova-compute[72894]:   <features>
Aug 16 20:11:46 user nova-compute[72894]:     <acpi/>
Aug 16 20:11:46 user nova-compute[72894]:     <apic/>
Aug 16 20:11:46 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:11:46 user nova-compute[72894]:   </features>
Aug 16 20:11:46 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:11:46 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:11:46 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:11:46 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:11:46 user nova-compute[72894]:   </clock>
Aug 16 20:11:46 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:11:46 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:11:46 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:11:46 user nova-compute[72894]:   </cpu>
Aug 16 20:11:46 user nova-compute[72894]:   <devices>
Aug 16 20:11:46 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:11:46 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:11:46 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk"/>
Aug 16 20:11:46 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:11:46 user nova-compute[72894]:     </disk>
Aug 16 20:11:46 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:11:46 user nova-compute[72894]:       <mac address="fa:16:3e:e5:4b:52"/>
Aug 16 20:11:46 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:11:46 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:11:46 user nova-compute[72894]:       <target dev="tap1b7defbc-19"/>
Aug 16 20:11:46 user nova-compute[72894]:     </interface>
Aug 16 20:11:46 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:11:46 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/console.log" append="off"/>
Aug 16 20:11:46 user nova-compute[72894]:     </serial>
Aug 16 20:11:46 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:11:46 user nova-compute[72894]:     <video>
Aug 16 20:11:46 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:11:46 user nova-compute[72894]:     </video>
Aug 16 20:11:46 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:11:46 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:11:46 user nova-compute[72894]:     </rng>
Aug 16 20:11:46 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:11:46 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:11:46 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:11:46 user nova-compute[72894]:     </memballoon>
Aug 16 20:11:46 user nova-compute[72894]:   </devices>
Aug 16 20:11:46 user nova-compute[72894]: </domain>
Aug 16 20:11:46 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1763343589',display_name='tempest-VolumesAdminNegativeTest-server-1763343589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1763343589',id=31,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-uo30cqjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:11:44Z,user_data=None,user_id='d7b74284f2c24d79bc01434de253ae70',uuid=7f29e2f8-0a16-42e9-9aae-364d429228aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG os_vif [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b7defbc-19, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b7defbc-19, col_values=(('external_ids', {'iface-id': '1b7defbc-19e0-48eb-ae49-00a7deecc110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:4b:52', 'vm-uuid': '7f29e2f8-0a16-42e9-9aae-364d429228aa'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:46 user nova-compute[72894]: INFO os_vif [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19')
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] No VIF found with MAC fa:16:3e:e5:4b:52, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Updated VIF entry in instance network info cache for port 1b7defbc-19e0-48eb-ae49-00a7deecc110. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Updating instance_info_cache with network_info: [{"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6e86152-a8be-4f8c-96de-8bdb9cd20710 req-327de954-6faf-4a99-a68a-cff294e786e4 service nova] Releasing lock "refresh_cache-7f29e2f8-0a16-42e9-9aae-364d429228aa" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26365666339363333', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365666339363333', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:11:46 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:11:46 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:11:46 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:11:46 user nova-compute[72894]:   <serial>9085192a-bc32-4bf9-afbb-1a198e59793a</serial>
Aug 16 20:11:46 user nova-compute[72894]: </disk>
Aug 16 20:11:46 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7103MB free_disk=24.103759765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No VIF found with MAC fa:16:3e:5e:d2:44, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Applying migration context for instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 as it has an incoming, in-progress migration dbb5b215-133d-43df-8997-40186d9807ab. Migration status is finished {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 20:11:47 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating resource usage from migration dbb5b215-133d-43df-8997-40186d9807ab
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 34d11735-e89e-4695-9ca5-d596a7b736b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Migration dbb5b215-133d-43df-8997-40186d9807ab is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7f29e2f8-0a16-42e9-9aae-364d429228aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ed09a873-cfcb-45a1-88db-f94f61d3a32a tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.237s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] No waiting events found dispatching network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:47 user nova-compute[72894]: WARNING nova.compute.manager [req-29f62ef3-847d-4b16-89cc-e1fca495072d req-49b7d204-1af2-4fa9-a6e7-6da53ab40971 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received unexpected event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 for instance with vm_state building and task_state spawning.
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:48 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:11:48 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:11:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:11:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216709.8387625, 7f29e2f8-0a16-42e9-9aae-364d429228aa => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] VM Resumed (Lifecycle Event)
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Instance spawned successfully.
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216709.8394608, 7f29e2f8-0a16-42e9-9aae-364d429228aa => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] VM Started (Lifecycle Event)
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:11:49 user nova-compute[72894]: INFO nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 16 20:11:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:11:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:11:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] No waiting events found dispatching network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:11:50 user nova-compute[72894]: WARNING nova.compute.manager [req-671720ab-7b74-47f2-b356-aa40a225d92b req-6f05bccf-878b-4720-99ca-32f203862f7c service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received unexpected event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 for instance with vm_state building and task_state spawning.
Aug 16 20:11:50 user nova-compute[72894]: INFO nova.compute.manager [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Took 7.12 seconds to build instance.
Aug 16 20:11:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-537aca05-3057-4376-b69a-3e03bce058af tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.212s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:11:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:11:51 user nova-compute[72894]: INFO nova.compute.manager [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attaching volume cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 to /dev/vdc
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.utils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a24a9e2-953c-49a8-945c-3264c392a7dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3414e89-065d-4231-8878-e9758b931e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b5c2e-e7d9-4120-bb64-0edd03e71158]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbcf90-90cd-4b57-a408-fba723acf5f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:11:52 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d0cf9a-442e-47a5-a761-353cfb592418]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG os_brick.utils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating existing volume attachment record: 228be532-4d4f-4b59-9d57-d4db1058330c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:11:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:11:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFoHplx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:03 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c83a4cf-e3c0-4e4a-8729-2c9be929e461]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:12:03 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b79873b-af17-4748-a2a0-fbba24b213c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045] added
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d56df5-759f-48da-80fa-4354f6306da5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4636832-ac8e-4827-a36f-0b540cf6b82b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWFoHplx {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWFoHplx" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1871f-696c-4183-8c6f-0769b169c38d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWFoHplx'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4588192-961e-4efa-8d17-3c9ce283f8ae]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc5a89-0dc0-4fd7-bf9c-36b44c700004]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66acf07-18e1-48c5-8fef-97b5a9da92b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260]
Aug 16 20:12:03 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260] successful.
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c604a-792c-4eb2-9256-0239b412e65b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a7d50-5174-4994-93c7-0671dc3a6620]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:03 user nova-compute[72894]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)
Aug 16 20:12:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[185accc5-7c93-435a-9de4-b1d92bc6d5a2]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFoHplx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:12:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23864646530643065', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646530643065', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:12:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:12:04 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:04 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:12:04 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:12:04 user nova-compute[72894]:   <serial>cbe95b59-65a1-4e85-b5d5-bbd93a5d0045</serial>
Aug 16 20:12:04 user nova-compute[72894]: </disk>
Aug 16 20:12:04 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] No VIF found with MAC fa:16:3e:5e:d2:44, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c736cf1-0537-4f96-855c-b97d2ad69019 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.234s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing instance network info cache due to event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:06 user nova-compute[72894]: INFO nova.compute.manager [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Detaching volume cbe95b59-65a1-4e85-b5d5-bbd93a5d0045
Aug 16 20:12:06 user nova-compute[72894]: INFO nova.virt.block_device [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attempting to driver detach volume cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 from mountpoint /dev/vdc
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Attempting to detach device vdc from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:12:06 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:06 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:12:06 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:12:06 user nova-compute[72894]:   <serial>cbe95b59-65a1-4e85-b5d5-bbd93a5d0045</serial>
Aug 16 20:12:06 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:12:06 user nova-compute[72894]: </disk>
Aug 16 20:12:06 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:12:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully detached device vdc from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the persistent domain config.
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:12:06 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:06 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:12:06 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:12:06 user nova-compute[72894]:   <serial>cbe95b59-65a1-4e85-b5d5-bbd93a5d0045</serial>
Aug 16 20:12:06 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:12:06 user nova-compute[72894]: </disk>
Aug 16 20:12:06 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updated VIF entry in instance network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f341bc6c-69de-47eb-acb8-1e9b954ba870 req-13902838-8a79-4cc2-afee-329ac0343559 service nova] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216726.9438832, cef80969-a51d-46a1-a5b1-d510ecb97f81 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:12:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully detached device vdc from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the live domain config.
Aug 16 20:12:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFoHplx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb181371-6579-49c5-afb3-eee5de3697c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff26e3-b666-4a9e-8b62-6ab9660ea0a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:07 user nova-compute[72894]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 (non-flash)
Aug 16 20:12:07 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799055dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59f636-cb65-4825-97d3-47b483f699ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca112777-8575-4944-812f-6236403169ff]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f4ed2e-8be2-41af-a2d5-2ebd78aa2ef4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238c2b3-f8ae-4e1b-b061-9e9d09bf8e16]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a05b4-d67a-436e-833e-ab8f2edaf892]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc00d493-30c3-493a-a06b-7e43eb23cf39]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260]
Aug 16 20:12:07 user nova-compute[72894]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045, portal: 172.16.0.220,3260] successful.
Aug 16 20:12:07 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe95b59-65a1-4e85-b5d5-bbd93a5d0045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ae15e-cf77-4612-a94e-0cc46b193579]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== disconnect_volume: return (320ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9548d425-d1b5-4d8e-a844-6cc587c5661f tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.815s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:12:08 user nova-compute[72894]: INFO nova.compute.claims [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Claim successful on node user
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:12:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.policy [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be3a706becb041598d5a63714a389801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb5629d37246269932266408249714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:12:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Creating image(s)
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk 1073741824" returned: 0 in 0.054s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Successfully created port: 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Cannot resize image /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Ensure instance console log exists: /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Successfully updated port: 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing instance network info cache due to event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:10 user nova-compute[72894]: INFO nova.compute.manager [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Shelving
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance network_info: |[{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start _get_guest_xml network_info=[{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334265123',display_name='tempest-ServerRescueNegativeTestJSON-server-1334265123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334265123',id=32,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8c+TxLZdyhgvXuBb333t0lKDfz6TZXsSOeTUL2YC40/onRwsDL/aUrDbBxX3xo9eKazQbgQdXbPFaHwm77Byu1mNEXyB+5/OmzBNaNRkNDnVWUfTZN3YwIov+4kALGFQ==',key_name='tempest-keypair-1836193020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-40r73tjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be3a706becb041598d5a63714a389801',uuid=6d796fab-6318-4e7b-8a75-ecc4db1db2af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:12:10 user nova-compute[72894]:   <uuid>6d796fab-6318-4e7b-8a75-ecc4db1db2af</uuid>
Aug 16 20:12:10 user nova-compute[72894]:   <name>instance-00000020</name>
Aug 16 20:12:10 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:12:10 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:12:10 user nova-compute[72894]:   <metadata>
Aug 16 20:12:10 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:12:10 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1334265123</nova:name>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:12:10</nova:creationTime>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:12:10 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:12:10 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:owner>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:12:10 user nova-compute[72894]:       </nova:owner>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:12:10 user nova-compute[72894]:       <nova:ports>
Aug 16 20:12:10 user nova-compute[72894]:         <nova:port uuid="8bbe259d-17fc-48f8-9ae2-748c2b92c28f">
Aug 16 20:12:10 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 20:12:10 user nova-compute[72894]:         </nova:port>
Aug 16 20:12:10 user nova-compute[72894]:       </nova:ports>
Aug 16 20:12:10 user nova-compute[72894]:     </nova:instance>
Aug 16 20:12:10 user nova-compute[72894]:   </metadata>
Aug 16 20:12:10 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:12:10 user nova-compute[72894]:     <system>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="serial">6d796fab-6318-4e7b-8a75-ecc4db1db2af</entry>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="uuid">6d796fab-6318-4e7b-8a75-ecc4db1db2af</entry>
Aug 16 20:12:10 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:12:10 user nova-compute[72894]:     </system>
Aug 16 20:12:10 user nova-compute[72894]:   </sysinfo>
Aug 16 20:12:10 user nova-compute[72894]:   <os>
Aug 16 20:12:10 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:12:10 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:12:10 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:12:10 user nova-compute[72894]:   </os>
Aug 16 20:12:10 user nova-compute[72894]:   <features>
Aug 16 20:12:10 user nova-compute[72894]:     <acpi/>
Aug 16 20:12:10 user nova-compute[72894]:     <apic/>
Aug 16 20:12:10 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:12:10 user nova-compute[72894]:   </features>
Aug 16 20:12:10 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:12:10 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:12:10 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:12:10 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:12:10 user nova-compute[72894]:   </clock>
Aug 16 20:12:10 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:12:10 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:12:10 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:12:10 user nova-compute[72894]:   </cpu>
Aug 16 20:12:10 user nova-compute[72894]:   <devices>
Aug 16 20:12:10 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:12:10 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:12:10 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk"/>
Aug 16 20:12:10 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:12:10 user nova-compute[72894]:     </disk>
Aug 16 20:12:10 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:12:10 user nova-compute[72894]:       <mac address="fa:16:3e:ea:7b:2a"/>
Aug 16 20:12:10 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:12:10 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:12:10 user nova-compute[72894]:       <target dev="tap8bbe259d-17"/>
Aug 16 20:12:10 user nova-compute[72894]:     </interface>
Aug 16 20:12:10 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:12:10 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/console.log" append="off"/>
Aug 16 20:12:10 user nova-compute[72894]:     </serial>
Aug 16 20:12:10 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:12:10 user nova-compute[72894]:     <video>
Aug 16 20:12:10 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:12:10 user nova-compute[72894]:     </video>
Aug 16 20:12:10 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:12:10 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:12:10 user nova-compute[72894]:     </rng>
Aug 16 20:12:10 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:12:10 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:12:10 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:12:10 user nova-compute[72894]:     </memballoon>
Aug 16 20:12:10 user nova-compute[72894]:   </devices>
Aug 16 20:12:10 user nova-compute[72894]: </domain>
Aug 16 20:12:10 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334265123',display_name='tempest-ServerRescueNegativeTestJSON-server-1334265123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334265123',id=32,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8c+TxLZdyhgvXuBb333t0lKDfz6TZXsSOeTUL2YC40/onRwsDL/aUrDbBxX3xo9eKazQbgQdXbPFaHwm77Byu1mNEXyB+5/OmzBNaNRkNDnVWUfTZN3YwIov+4kALGFQ==',key_name='tempest-keypair-1836193020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-40r73tjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be3a706becb041598d5a63714a389801',uuid=6d796fab-6318-4e7b-8a75-ecc4db1db2af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG os_vif [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bbe259d-17, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bbe259d-17, col_values=(('external_ids', {'iface-id': '8bbe259d-17fc-48f8-9ae2-748c2b92c28f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:7b:2a', 'vm-uuid': '6d796fab-6318-4e7b-8a75-ecc4db1db2af'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:11 user nova-compute[72894]: WARNING nova.compute.manager [req-d6a398e5-0cb8-4252-bfa1-b00b27b8d95f req-986e484e-b5cf-495b-bf89-677f1018dd49 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state active and task_state shelving.
Aug 16 20:12:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:11 user nova-compute[72894]: INFO os_vif [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17')
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:ea:7b:2a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updated VIF entry in instance network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7c8f4a9d-950c-470d-b79a-717b1f52e291 req-700faa4b-44c7-4126-b32a-b999951674f9 service nova] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance destroyed successfully.
Aug 16 20:12:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Beginning cold snapshot process
Aug 16 20:12:12 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk /opt/stack/data/nova/instances/snapshots/tmp6ijl09iq/4938bfd59c954bfe99e1b207b8c3b433 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk /opt/stack/data/nova/instances/snapshots/tmp6ijl09iq/4938bfd59c954bfe99e1b207b8c3b433" returned: 0 in 0.746s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Snapshot extracted, beginning image upload
Aug 16 20:12:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:13 user nova-compute[72894]: WARNING nova.compute.manager [req-102e1b5c-5212-40d1-a604-b3cb7594101b req-25d52c78-3c9e-4afd-80a8-0cb7c0bf38d1 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state building and task_state spawning.
Aug 16 20:12:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:13 user nova-compute[72894]: WARNING nova.compute.manager [req-9fe18f14-bfc1-4bfd-8642-114c20635c54 req-85d5600c-3716-4158-b548-2dfeee23428d service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 20:12:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:15 user nova-compute[72894]: WARNING nova.compute.manager [req-944675b0-d86b-4f72-88e8-506bf22e6892 req-338e0c68-9c7b-4ce5-b8a2-5e701544a97d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state building and task_state spawning.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216735.1434164, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Resumed (Lifecycle Event)
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance spawned successfully.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216735.1444557, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Started (Lifecycle Event)
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Took 7.23 seconds to build instance.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fce9af9a-d951-4dd0-8a8f-113ba327950d tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.369s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Snapshot image upload complete
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.compute.manager [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Shelve offloading
Aug 16 20:12:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance destroyed successfully.
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:12:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance destroyed successfully.
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'resources' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXqJQ3OSCxbhn6FeS/X4MuALkvHiA46IOCQJPAvjaSPbelmIfJEP+4QzoIOU8aU8a/gxD1LBAsiurn0QfipO/CiOmj55xCkUnEmbwylWMUBJ3smZpDdgTOOOhgqapdI0Q==',key_name='tempest-keypair-1947199152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:12:15.870358',shelved_host='user',shelved_image_id='698bc932-2657-468e-81b5-3fc72b59f934'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG os_vif [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae15471-0b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:17 user nova-compute[72894]: INFO os_vif [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b')
Aug 16 20:12:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Deleting instance files /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1_del
Aug 16 20:12:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Deletion of /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1_del complete
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing instance network info cache due to event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:12:17 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Deleted allocations for instance 34d11735-e89e-4695-9ca5-d596a7b736b1
Aug 16 20:12:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'numa_topology' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updated VIF entry in instance network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4ae15471-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65574035-8f0e-4011-912f-b7ba64c34c05 req-d4392b2e-9567-4348-8dbe-2e336a115cfc service nova] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.708s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d350104e-8e3b-4277-80e7-9af5a8348981 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.948s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:21 user nova-compute[72894]: INFO nova.compute.manager [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Attaching volume 3303ecdc-9f43-41db-8c1e-1a67080a89db to /dev/vdb
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.utils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[de907ee7-2af7-4b2f-91a8-96b9419888f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[312401e7-cba4-4145-97ab-ab3c7caf4e91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b0784-b0ab-47e2-abbc-a3c7e7b2e581]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb838659-234f-4131-8dfb-e9eab5937576]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:12:21 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:12:21 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b3ed4-2231-4416-90b7-44b6e3af3a7e]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG os_brick.utils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:21 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating existing volume attachment record: c238a848-9607-45b3-a5c4-baf64a2c7e91 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:12:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:27 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216732.000352, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:27 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Stopped (Lifecycle Event)
Aug 16 20:12:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d2076097-c88c-483e-819b-84bb43068070 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:12:32 user nova-compute[72894]: INFO nova.compute.claims [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Claim successful on node user
Aug 16 20:12:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:12:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:12:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:12:32 user nova-compute[72894]: INFO nova.virt.block_device [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Booting with volume 733e6986-36f7-483c-93f7-f6bae2b4ff2d at /dev/vda
Aug 16 20:12:33 user nova-compute[72894]: DEBUG nova.policy [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e38ef-1843-4ef4-840f-8e2d216ed83c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07184a0-04c1-4bf4-a9f5-8e93f03c859d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b690c2a-e71f-425b-97f6-070ef9008ac8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e41c0f-7b99-48b6-a1c0-f842c1e00700]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:12:33 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:12:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e85c359-0c43-413d-96a1-8b19fd1e7a31]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updating existing volume attachment record: 496d8472-c9eb-4a83-8575-ac0ea92eb74b {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Successfully created port: 462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:12:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Successfully updated port: 462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-changed-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Refreshing instance network info cache due to event network-changed-462a0396-50f6-4fe4-a3bf-2d091b647e08. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] Acquiring lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updating instance_info_cache with network_info: [{"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Instance network_info: |[{"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] Acquired lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:34 user nova-compute[72894]: DEBUG nova.network.neutron [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Refreshing network info cache for port 462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:12:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updated VIF entry in instance network info cache for port 462a0396-50f6-4fe4-a3bf-2d091b647e08. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:12:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updating instance_info_cache with network_info: [{"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-056b431a-e677-482a-b890-17cbc27f44e2 req-ec465a06-608c-4af5-b05d-747a48741ab4 service nova] Releasing lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:12:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:12:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:46 user nova-compute[72894]: INFO nova.compute.manager [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Unrescuing
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquired lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [{"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Releasing lock "refresh_cache-9e018532-ae8e-4b6f-9931-18a006bdfc78" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'flavor' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:48 user nova-compute[72894]: WARNING nova.compute.manager [req-d53863ec-caac-43d4-adf3-714877a98121 req-88721a43-2934-45d8-9074-6d6a1e0bb4ef service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:12:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:12:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance destroyed successfully.
Aug 16 20:12:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=6949MB free_disk=24.013397216796875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Applying migration context for instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 as it has an incoming, in-progress migration dbb5b215-133d-43df-8997-40186d9807ab. Migration status is finished {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 20:12:48 user nova-compute[72894]: INFO nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating resource usage from migration dbb5b215-133d-43df-8997-40186d9807ab
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Migration dbb5b215-133d-43df-8997-40186d9807ab is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7f29e2f8-0a16-42e9-9aae-364d429228aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance fa5d9981-df95-4a41-995a-9c38396efc8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:12:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:49 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:49 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:49 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7718f3b-a152-4120-a17f-7c3c0c236314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:12:49 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4597df-74b3-41e0-a98c-d0a52e04fd67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db] added
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f8d93-e26c-4c1e-bd31-3c8372e339a2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[68852ab7-f18e-430f-92c7-f8dc248dc0d4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:49 user nova-compute[72894]: WARNING nova.compute.manager [req-65a6bbde-4b43-4fbb-ba46-19d8f2b63991 req-fa7c1f5c-a701-412a-8006-762c2d08ff70 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odKnJetC {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odKnJetC" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453a7bc-7a6d-4280-923d-da57e3a0a9f1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odKnJetC'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc652a4-bdb2-4564-9963-d05c3861881c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d15a0-6561-4da2-82b7-7afbea1d4504]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935924f-dbd8-4f61-93a0-0d6f45de7725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]
Aug 16 20:12:49 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c3f7b6-1b9c-4bfe-bf3a-c1cfee766bf5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1fa1ce-8a30-4c42-8368-03ea8c9a6887]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:49 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1404d41a-13ee-4eee-8c97-f2f98830859e]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:12:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26563626263623861', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563626263623861', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:12:50 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:50 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:12:50 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:12:50 user nova-compute[72894]:   <serial>3303ecdc-9f43-41db-8c1e-1a67080a89db</serial>
Aug 16 20:12:50 user nova-compute[72894]: </disk>
Aug 16 20:12:50 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No VIF found with MAC fa:16:3e:59:d1:ae, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2dc73194-e8dc-4a0d-9823-2457978fdb61 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.880s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:51 user nova-compute[72894]: WARNING nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:51 user nova-compute[72894]: WARNING nova.compute.manager [req-a0ace622-5dad-4cf8-a368-1aed1aca62a1 req-c6d62d5b-4ac8-4393-a586-721a20e46fb5 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:12:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Creating image(s)
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Ensure instance console log exists: /opt/stack/data/nova/instances/fa5d9981-df95-4a41-995a-9c38396efc8b/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Start _get_guest_xml network_info=[{"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '496d8472-c9eb-4a83-8575-ac0ea92eb74b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa5d9981-df95-4a41-995a-9c38396efc8b', 'attached_at': '', 'detached_at': '', 'volume_id': '733e6986-36f7-483c-93f7-f6bae2b4ff2d', 'serial': '733e6986-36f7-483c-93f7-f6bae2b4ff2d'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:12:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:51 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:51 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:51 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4982e7f4-a9f6-42df-bef3-6c959b458b03 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 9e018532-ae8e-4b6f-9931-18a006bdfc78 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216771.8721516, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:51 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Resumed (Lifecycle Event)
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f4234-f80e-45b8-9ced-93ddb72424e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:12:51 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb4e06-d599-468a-ba2f-031efcb1857a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d] added
Aug 16 20:12:51 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:51 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216771.873271, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:51 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Started (Lifecycle Event)
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c75d40-0fea-41d5-85bd-51c546a04dbb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5444e94-37da-425d-9d87-1a038c9a8bf3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQDhdtrL {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQDhdtrL" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c812f-a0ee-4fe5-bad0-15e1eb2d604d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQDhdtrL'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef7a97-cb90-4a28-b1db-51e9951d8af9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238cee0-e05a-4ecc-bcf0-968653e7e890]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03182f-9da9-4a70-9948-da24a45f6153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]
Aug 16 20:12:52 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.
Aug 16 20:12:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5dd7a-3446-4914-b0b9-2cb4ac60a448]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b449d-b0a7-42ba-beb8-b588d8f5d5b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:12:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:52 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:12:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaa92c6-8d61-4dfc-99bc-79b3085be39f]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23963626639336361', 'path': '/dev/sdf'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963626639336361', 'path': '/dev/sdf'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743186128',display_name='tempest-TestVolumeBootPattern-server-743186128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743186128',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-n3rvz36d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:12:33Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=fa5d9981-df95-4a41-995a-9c38396efc8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid fa5d9981-df95-4a41-995a-9c38396efc8b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:12:53 user nova-compute[72894]:   <uuid>fa5d9981-df95-4a41-995a-9c38396efc8b</uuid>
Aug 16 20:12:53 user nova-compute[72894]:   <name>instance-00000021</name>
Aug 16 20:12:53 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:12:53 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:12:53 user nova-compute[72894]:   <metadata>
Aug 16 20:12:53 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:12:53 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:12:53 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-server-743186128</nova:name>
Aug 16 20:12:53 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:12:51</nova:creationTime>
Aug 16 20:12:53 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:12:53 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:12:53 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:12:53 user nova-compute[72894]:       <nova:owner>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:12:53 user nova-compute[72894]:       </nova:owner>
Aug 16 20:12:53 user nova-compute[72894]:       <nova:ports>
Aug 16 20:12:53 user nova-compute[72894]:         <nova:port uuid="462a0396-50f6-4fe4-a3bf-2d091b647e08">
Aug 16 20:12:53 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 20:12:53 user nova-compute[72894]:         </nova:port>
Aug 16 20:12:53 user nova-compute[72894]:       </nova:ports>
Aug 16 20:12:53 user nova-compute[72894]:     </nova:instance>
Aug 16 20:12:53 user nova-compute[72894]:   </metadata>
Aug 16 20:12:53 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:12:53 user nova-compute[72894]:     <system>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="serial">fa5d9981-df95-4a41-995a-9c38396efc8b</entry>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="uuid">fa5d9981-df95-4a41-995a-9c38396efc8b</entry>
Aug 16 20:12:53 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:12:53 user nova-compute[72894]:     </system>
Aug 16 20:12:53 user nova-compute[72894]:   </sysinfo>
Aug 16 20:12:53 user nova-compute[72894]:   <os>
Aug 16 20:12:53 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:12:53 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:12:53 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:12:53 user nova-compute[72894]:   </os>
Aug 16 20:12:53 user nova-compute[72894]:   <features>
Aug 16 20:12:53 user nova-compute[72894]:     <acpi/>
Aug 16 20:12:53 user nova-compute[72894]:     <apic/>
Aug 16 20:12:53 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:12:53 user nova-compute[72894]:   </features>
Aug 16 20:12:53 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:12:53 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:12:53 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:12:53 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:12:53 user nova-compute[72894]:   </clock>
Aug 16 20:12:53 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:12:53 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:12:53 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:12:53 user nova-compute[72894]:   </cpu>
Aug 16 20:12:53 user nova-compute[72894]:   <devices>
Aug 16 20:12:53 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:12:53 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:53 user nova-compute[72894]:       <source dev="/dev/sdf"/>
Aug 16 20:12:53 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:12:53 user nova-compute[72894]:       <serial>733e6986-36f7-483c-93f7-f6bae2b4ff2d</serial>
Aug 16 20:12:53 user nova-compute[72894]:     </disk>
Aug 16 20:12:53 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:12:53 user nova-compute[72894]:       <mac address="fa:16:3e:28:e6:e7"/>
Aug 16 20:12:53 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:12:53 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:12:53 user nova-compute[72894]:       <target dev="tap462a0396-50"/>
Aug 16 20:12:53 user nova-compute[72894]:     </interface>
Aug 16 20:12:53 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:12:53 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/fa5d9981-df95-4a41-995a-9c38396efc8b/console.log" append="off"/>
Aug 16 20:12:53 user nova-compute[72894]:     </serial>
Aug 16 20:12:53 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:12:53 user nova-compute[72894]:     <video>
Aug 16 20:12:53 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:12:53 user nova-compute[72894]:     </video>
Aug 16 20:12:53 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:12:53 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:12:53 user nova-compute[72894]:     </rng>
Aug 16 20:12:53 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:12:53 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:12:53 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:12:53 user nova-compute[72894]:     </memballoon>
Aug 16 20:12:53 user nova-compute[72894]:   </devices>
Aug 16 20:12:53 user nova-compute[72894]: </domain>
Aug 16 20:12:53 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743186128',display_name='tempest-TestVolumeBootPattern-server-743186128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743186128',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-n3rvz36d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:12:33Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=fa5d9981-df95-4a41-995a-9c38396efc8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG os_vif [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap462a0396-50, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap462a0396-50, col_values=(('external_ids', {'iface-id': '462a0396-50f6-4fe4-a3bf-2d091b647e08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e6:e7', 'vm-uuid': 'fa5d9981-df95-4a41-995a-9c38396efc8b'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:53 user nova-compute[72894]: INFO os_vif [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50')
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:12:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:28:e6:e7, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] No waiting events found dispatching network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:54 user nova-compute[72894]: WARNING nova.compute.manager [req-3ab256a3-9667-4006-8389-55a29dd627ef req-edecdf26-020c-4446-a8ba-f47189b83989 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received unexpected event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 for instance with vm_state building and task_state spawning.
Aug 16 20:12:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:56 user nova-compute[72894]: INFO nova.compute.manager [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Detaching volume 9085192a-bc32-4bf9-afbb-1a198e59793a
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] No waiting events found dispatching network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:12:57 user nova-compute[72894]: WARNING nova.compute.manager [req-7dee9af0-0f7f-4898-9a06-5ce6fe845bc7 req-99b16271-778b-4624-8479-a733d86e38b7 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received unexpected event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 for instance with vm_state building and task_state spawning.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216777.0901356, fa5d9981-df95-4a41-995a-9c38396efc8b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] VM Resumed (Lifecycle Event)
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.virt.block_device [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Attempting to driver detach volume 9085192a-bc32-4bf9-afbb-1a198e59793a from mountpoint /dev/vdb
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Instance spawned successfully.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Attempting to detach device vdb from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:12:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:57 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:12:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:12:57 user nova-compute[72894]:   <serial>9085192a-bc32-4bf9-afbb-1a198e59793a</serial>
Aug 16 20:12:57 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:12:57 user nova-compute[72894]: </disk>
Aug 16 20:12:57 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully detached device vdb from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the persistent domain config.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:12:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:12:57 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:12:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:12:57 user nova-compute[72894]:   <serial>9085192a-bc32-4bf9-afbb-1a198e59793a</serial>
Aug 16 20:12:57 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:12:57 user nova-compute[72894]: </disk>
Aug 16 20:12:57 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216777.091406, fa5d9981-df95-4a41-995a-9c38396efc8b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] VM Started (Lifecycle Event)
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.compute.manager [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Took 25.20 seconds to build instance.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a8ebc119-d8cd-4811-9df2-d5cdbd4a4bbf tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.295s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216777.6029682, cef80969-a51d-46a1-a5b1-d510ecb97f81 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:12:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully detached device vdb from instance cef80969-a51d-46a1-a5b1-d510ecb97f81 from the live domain config.
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puWmHtQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:12:57 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[33620800-2627-4591-b3ec-2aae661d2756]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0340bf-db62-4729-818b-240913e32bc5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:12:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:12:57 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:12:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4afba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de0f283-ac1c-4293-9794-f75205073e6e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b1a11a-2c8b-4760-b228-ff9e41d6e509]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb39cf8-20c9-4469-9ac0-ef1788436735]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0cb17-9c98-43a7-9dd2-17522cb32a8e]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f1f26-9653-4d4f-b910-bffe71821d41]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ff37d-4a5c-4c97-b399-e58c3abf38dc]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260]
Aug 16 20:12:57 user nova-compute[72894]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a, portal: 172.16.0.220,3260] successful.
Aug 16 20:12:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9085192a-bc32-4bf9-afbb-1a198e59793a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[efefa5c8-63b7-4ebd-8da8-113d31e6e8f4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] <== disconnect_volume: return (347ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:12:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:12:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:12:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'flavor' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:12:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a937dfcf-ba1c-4409-a72f-5056fc5df657 tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.907s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:12:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Going to confirm migration 2 {{(pid=72894) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquired lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:13:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'info_cache' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [{"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Releasing lock "refresh_cache-4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'migration_context' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:13:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.565s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:03 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Deleted allocation for migration dbb5b215-133d-43df-8997-40186d9807ab
Aug 16 20:13:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b37258b6-dc2d-4207-879f-87ef81726ba3 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.014s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:04 user nova-compute[72894]: DEBUG nova.compute.manager [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:04 user nova-compute[72894]: DEBUG nova.compute.manager [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing instance network info cache due to event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:13:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:04 user nova-compute[72894]: DEBUG nova.network.neutron [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:13:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updated VIF entry in instance network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:13:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ccf4ac52-7d03-4ed6-affa-de689139bac7 req-d6ae0c3d-adf1-4545-95ab-046958b68a6f service nova] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:13:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing instance network info cache due to event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:13:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:13:07 user nova-compute[72894]: DEBUG nova.network.neutron [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updated VIF entry in instance network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:13:07 user nova-compute[72894]: DEBUG nova.network.neutron [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7d03846a-3398-4bec-a5c7-e869b5da0fc3 req-50ebee69-102b-4668-a23b-920c954158e7 service nova] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:13:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:17 user nova-compute[72894]: INFO nova.compute.manager [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Rebooting instance
Aug 16 20:13:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:18 user nova-compute[72894]: WARNING nova.compute.manager [req-181b3a00-0d0d-4a18-a916-aed1048651f0 req-11f7dd86-a8c0-4a4b-a624-00daceaf24e3 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 20:13:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance destroyed successfully.
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'resources' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:13:18Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bcca30-6f, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:13:18 user nova-compute[72894]: INFO os_vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f')
Aug 16 20:13:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:13:18 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e247a98-057b-4c34-ab39-1e7bccfb0fa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3bf95-8ab1-4eb5-9c89-eea24bcd3d97]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:13:18 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799066d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6422e3-c863-4522-8454-6722361cfe65]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa1f36-de47-425b-a2e2-0744856657a8]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddba9d4-3a8a-4d1c-9938-bb559c83c15f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c346c46-4abf-4d63-b00d-a690a37233f8]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50bbb3f-8c03-48ba-94f0-71cfdcbf05c9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dae174-babf-4a55-89d9-ef774a5ba66e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]
Aug 16 20:13:18 user nova-compute[72894]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.
Aug 16 20:13:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6567560-d146-4102-af5a-7694f787dd8b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== disconnect_volume: return (345ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start _get_guest_xml network_info=[{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09029edf-bcb8-4a49-819b-f792f8fb87bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '09029edf-bcb8-4a49-819b-f792f8fb87bb'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'c238a848-9607-45b3-a5c4-baf64a2c7e91', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e3fa3ace-3292-4957-aa6a-98f14b12795f', 'attached_at': '', 'detached_at': '', 'volume_id': '3303ecdc-9f43-41db-8c1e-1a67080a89db', 'serial': '3303ecdc-9f43-41db-8c1e-1a67080a89db'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:13:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:13:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09029edf-bcb8-4a49-819b-f792f8fb87bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:13:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:13:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:13:19 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a91227-5528-442d-a733-49d202ba4b8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:13:19 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b68572-0f25-44dc-92ec-1528c5423e8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db] added
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e09f1d-0b90-4a76-9171-28ee4a703ade]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa04d92-1842-4054-bc24-9167f4978c1e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odKnJetC {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odKnJetC" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[762efe07-538a-4879-b161-b65a4c8ec6c4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odKnJetC'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701b73f-d74b-4888-92a4-a39761bce2ec]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df5174-344f-4739-8a41-ffcd17cde0e9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e48de-9f13-4f54-9c89-ea899cd99129]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]
Aug 16 20:13:19 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c21856d-71a9-4294-aa28-0a917a81b089]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4f2a7-9947-440c-96b5-8579712e2257]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:13:19 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:13:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a364fc-26df-41c0-9fe5-ea005f7cbe4b]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:13:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:20 user nova-compute[72894]: WARNING nova.compute.manager [req-c6457fd2-82ba-499e-af9e-3a02989f9918 req-45bf9509-c440-4b4e-afe7-57fd1d92d313 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 20:13:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26563626263623861', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563626263623861', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:13:18Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'pci_devices' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:13:20 user nova-compute[72894]:   <uuid>e3fa3ace-3292-4957-aa6a-98f14b12795f</uuid>
Aug 16 20:13:20 user nova-compute[72894]:   <name>instance-0000001e</name>
Aug 16 20:13:20 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:13:20 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:13:20 user nova-compute[72894]:   <metadata>
Aug 16 20:13:20 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:13:20 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:name>tempest-TestMinimumBasicScenario-server-267363048</nova:name>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:13:19</nova:creationTime>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:13:20 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:13:20 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:owner>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:user uuid="1b2c321a6776409a9dea0f817f58e07a">tempest-TestMinimumBasicScenario-872391646-project-member</nova:user>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:project uuid="d28ea40d38684e26a5abd0292d031801">tempest-TestMinimumBasicScenario-872391646</nova:project>
Aug 16 20:13:20 user nova-compute[72894]:       </nova:owner>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:root type="image" uuid="09029edf-bcb8-4a49-819b-f792f8fb87bb"/>
Aug 16 20:13:20 user nova-compute[72894]:       <nova:ports>
Aug 16 20:13:20 user nova-compute[72894]:         <nova:port uuid="22bcca30-6f46-415c-be4a-92cb214928e8">
Aug 16 20:13:20 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:13:20 user nova-compute[72894]:         </nova:port>
Aug 16 20:13:20 user nova-compute[72894]:       </nova:ports>
Aug 16 20:13:20 user nova-compute[72894]:     </nova:instance>
Aug 16 20:13:20 user nova-compute[72894]:   </metadata>
Aug 16 20:13:20 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:13:20 user nova-compute[72894]:     <system>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="serial">e3fa3ace-3292-4957-aa6a-98f14b12795f</entry>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="uuid">e3fa3ace-3292-4957-aa6a-98f14b12795f</entry>
Aug 16 20:13:20 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:13:20 user nova-compute[72894]:     </system>
Aug 16 20:13:20 user nova-compute[72894]:   </sysinfo>
Aug 16 20:13:20 user nova-compute[72894]:   <os>
Aug 16 20:13:20 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:13:20 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:13:20 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:13:20 user nova-compute[72894]:   </os>
Aug 16 20:13:20 user nova-compute[72894]:   <features>
Aug 16 20:13:20 user nova-compute[72894]:     <acpi/>
Aug 16 20:13:20 user nova-compute[72894]:     <apic/>
Aug 16 20:13:20 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:13:20 user nova-compute[72894]:   </features>
Aug 16 20:13:20 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:13:20 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:13:20 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:13:20 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:13:20 user nova-compute[72894]:   </clock>
Aug 16 20:13:20 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:13:20 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:13:20 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:13:20 user nova-compute[72894]:   </cpu>
Aug 16 20:13:20 user nova-compute[72894]:   <devices>
Aug 16 20:13:20 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:13:20 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:13:20 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk"/>
Aug 16 20:13:20 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:13:20 user nova-compute[72894]:     </disk>
Aug 16 20:13:20 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:13:20 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:13:20 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 20:13:20 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:13:20 user nova-compute[72894]:       <serial>3303ecdc-9f43-41db-8c1e-1a67080a89db</serial>
Aug 16 20:13:20 user nova-compute[72894]:     </disk>
Aug 16 20:13:20 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:13:20 user nova-compute[72894]:       <mac address="fa:16:3e:59:d1:ae"/>
Aug 16 20:13:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:13:20 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:13:20 user nova-compute[72894]:       <target dev="tap22bcca30-6f"/>
Aug 16 20:13:20 user nova-compute[72894]:     </interface>
Aug 16 20:13:20 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:13:20 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/console.log" append="off"/>
Aug 16 20:13:20 user nova-compute[72894]:     </serial>
Aug 16 20:13:20 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:13:20 user nova-compute[72894]:     <video>
Aug 16 20:13:20 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:13:20 user nova-compute[72894]:     </video>
Aug 16 20:13:20 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:13:20 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:13:20 user nova-compute[72894]:     </rng>
Aug 16 20:13:20 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:13:20 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:13:20 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:13:20 user nova-compute[72894]:     </memballoon>
Aug 16 20:13:20 user nova-compute[72894]:   </devices>
Aug 16 20:13:20 user nova-compute[72894]: </domain>
Aug 16 20:13:20 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Cannot resize image /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'migration_context' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:13:18Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG os_vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bcca30-6f, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22bcca30-6f, col_values=(('external_ids', {'iface-id': '22bcca30-6f46-415c-be4a-92cb214928e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:d1:ae', 'vm-uuid': 'e3fa3ace-3292-4957-aa6a-98f14b12795f'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:13:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:21 user nova-compute[72894]: INFO os_vif [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f')
Aug 16 20:13:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:22 user nova-compute[72894]: WARNING nova.compute.manager [req-bb99bd41-ee05-4b9d-9d51-bb1f9e6172ad req-efc8bf2d-e0f4-4bcf-9270-0d3d579fbf08 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 20:13:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for e3fa3ace-3292-4957-aa6a-98f14b12795f due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216804.7613392, e3fa3ace-3292-4957-aa6a-98f14b12795f => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:13:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] VM Resumed (Lifecycle Event)
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:13:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance rebooted successfully.
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:13:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216804.761901, e3fa3ace-3292-4957-aa6a-98f14b12795f => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:13:24 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] VM Started (Lifecycle Event)
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5e4bbcb-4cbb-42fc-a5b7-0e0aabfc1946 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.771s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:24 user nova-compute[72894]: WARNING nova.compute.manager [req-ececa9c5-e30b-4b6c-8647-cf45b4257296 req-81328d3c-3416-4553-9c37-c6e65d0fd012 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state None.
Aug 16 20:13:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updating instance_info_cache with network_info: [{"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-d08b5d90-e83b-4894-8507-a5904a9f7098" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:13:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:44 user nova-compute[72894]: INFO nova.compute.manager [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Terminating instance
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-unplugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] No waiting events found dispatching network-vif-unplugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-e51213bd-4a03-4fb5-8224-b45152610e35 req-225ad1a5-c7ca-494d-a834-48c805f5e440 service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-unplugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:13:44 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Instance destroyed successfully.
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'resources' on Instance uuid 7f29e2f8-0a16-42e9-9aae-364d429228aa {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1763343589',display_name='tempest-VolumesAdminNegativeTest-server-1763343589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1763343589',id=31,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-uo30cqjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:11:50Z,user_data=None,user_id='d7b74284f2c24d79bc01434de253ae70',uuid=7f29e2f8-0a16-42e9-9aae-364d429228aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "address": "fa:16:3e:e5:4b:52", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b7defbc-19", "ovs_interfaceid": "1b7defbc-19e0-48eb-ae49-00a7deecc110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG os_vif [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b7defbc-19, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:13:44 user nova-compute[72894]: INFO os_vif [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:52,bridge_name='br-int',has_traffic_filtering=True,id=1b7defbc-19e0-48eb-ae49-00a7deecc110,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b7defbc-19')
Aug 16 20:13:44 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Deleting instance files /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa_del
Aug 16 20:13:44 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Deletion of /opt/stack/data/nova/instances/7f29e2f8-0a16-42e9-9aae-364d429228aa_del complete
Aug 16 20:13:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:44 user nova-compute[72894]: INFO nova.compute.manager [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:13:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:45 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid '7f29e2f8-0a16-42e9-9aae-364d429228aa' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid '7f29e2f8-0a16-42e9-9aae-364d429228aa' (instance-0000001f)
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Took 0.49 seconds to deallocate network for instance.
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:45 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:46 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Deleted allocations for instance 7f29e2f8-0a16-42e9-9aae-364d429228aa
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bccb4203-3a9b-4697-a8da-421f53b9a016 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] Acquiring lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] Lock "7f29e2f8-0a16-42e9-9aae-364d429228aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] No waiting events found dispatching network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:46 user nova-compute[72894]: WARNING nova.compute.manager [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received unexpected event network-vif-plugged-1b7defbc-19e0-48eb-ae49-00a7deecc110 for instance with vm_state deleted and task_state None.
Aug 16 20:13:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-c8fa199e-cc14-4965-89c5-fe43665f160b req-f9727fe6-57f2-4063-b063-7472ebb8a79f service nova] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Received event network-vif-deleted-1b7defbc-19e0-48eb-ae49-00a7deecc110 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:47 user nova-compute[72894]: INFO nova.compute.manager [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Terminating instance
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-unplugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] No waiting events found dispatching network-vif-unplugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.compute.manager [req-fb761e8a-5f42-4d19-9bf6-8dc22d49c92c req-97a9a3e9-f3cd-4062-a775-c733def645c9 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-unplugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Instance destroyed successfully.
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lazy-loading 'resources' on Instance uuid cef80969-a51d-46a1-a5b1-d510ecb97f81 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1820240320',display_name='tempest-TestServerVolumeAttachmentScenario-server-1820240320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1820240320',id=28,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI459cuE0qLXm3kX2FOJx/aR81hz2IEEmTubvnDhVWF7zLFCD5a5+Td+CbGyC8BfI/FEjEM/ItO2C5Spnu7b83wpA3uZRKLmu+cLKi7QkwQO9DW7yh26syz9b+6jhedbaQ==',key_name='tempest-keypair-201223740',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:09:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1c256d8fe54527ac7f6decf747f0a8',ramdisk_id='',reservation_id='r-7pzva80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1423853584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1423853584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26e4d21c54640919f6cb9b2f010dc43',uuid=cef80969-a51d-46a1-a5b1-d510ecb97f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converting VIF {"id": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "address": "fa:16:3e:5e:d2:44", "network": {"id": "38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1860147356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1c256d8fe54527ac7f6decf747f0a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb938d-3c", "ovs_interfaceid": "eefb938d-3ca8-424e-aa08-c4139d8cd81c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG os_vif [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeefb938d-3c, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:48 user nova-compute[72894]: INFO os_vif [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=eefb938d-3ca8-424e-aa08-c4139d8cd81c,network=Network(38ec238a-10ae-4dc5-a3ae-27ddc65eb7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb938d-3c')
Aug 16 20:13:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Deleting instance files /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81_del
Aug 16 20:13:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Deletion of /opt/stack/data/nova/instances/cef80969-a51d-46a1-a5b1-d510ecb97f81_del complete
Aug 16 20:13:48 user nova-compute[72894]: INFO nova.compute.manager [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:13:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f78936c-156b-4aad-9d88-4215b5e3d95d req-ae1633da-38a6-488d-bd0b-12e2befcf6c2 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-deleted-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:49 user nova-compute[72894]: INFO nova.compute.manager [req-3f78936c-156b-4aad-9d88-4215b5e3d95d req-ae1633da-38a6-488d-bd0b-12e2befcf6c2 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Neutron deleted interface eefb938d-3ca8-424e-aa08-c4139d8cd81c; detaching it from the instance and deleting it from the info cache
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.network.neutron [req-3f78936c-156b-4aad-9d88-4215b5e3d95d req-ae1633da-38a6-488d-bd0b-12e2befcf6c2 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:13:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=6922MB free_disk=24.001922607421875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f78936c-156b-4aad-9d88-4215b5e3d95d req-ae1633da-38a6-488d-bd0b-12e2befcf6c2 service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Detach interface failed, port_id=eefb938d-3ca8-424e-aa08-c4139d8cd81c, reason: Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:13:49 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Took 0.99 seconds to deallocate network for instance.
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance eee52fdd-dc11-4f58-9e51-483a6a771403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance cef80969-a51d-46a1-a5b1-d510ecb97f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance fa5d9981-df95-4a41-995a-9c38396efc8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] Acquiring lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] No waiting events found dispatching network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:13:49 user nova-compute[72894]: WARNING nova.compute.manager [req-fc8bf9ef-098a-4978-a7f5-03b65936a675 req-4a539612-4591-4b5a-a87e-59734613902e service nova] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Received unexpected event network-vif-plugged-eefb938d-3ca8-424e-aa08-c4139d8cd81c for instance with vm_state deleted and task_state None.
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.519s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:50 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Deleted allocations for instance cef80969-a51d-46a1-a5b1-d510ecb97f81
Aug 16 20:13:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6dbcbd4d-0b8e-4bd2-ab01-e6eb54c5f75e tempest-TestServerVolumeAttachmentScenario-1423853584 tempest-TestServerVolumeAttachmentScenario-1423853584-project-member] Lock "cef80969-a51d-46a1-a5b1-d510ecb97f81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.107s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:13:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:13:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing instance network info cache due to event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216824.7223883, 7f29e2f8-0a16-42e9-9aae-364d429228aa => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:13:59 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] VM Stopped (Lifecycle Event)
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-70ec7ab9-e806-4ed4-9a1c-220fb666b11a None None] [instance: 7f29e2f8-0a16-42e9-9aae-364d429228aa] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'flavor' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:13:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:00 user nova-compute[72894]: INFO nova.compute.manager [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Attaching volume 8aacb8c8-4eef-4b3b-8f19-a817160225e2 to /dev/vdb
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.utils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[36182790-fb95-4d1c-a259-73d959e7222d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updated VIF entry in instance network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8a097-2dcf-4ece-86e0-f90477383ab0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-02c1eb3d-0002-44ef-8db4-e98a5fead3fa req-e49ab219-1ed6-44b2-8609-4c569964f3d5 service nova] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[646ffb13-b2dd-491c-926f-1084ae2d62e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1078ca-1cfb-49af-974a-2ee406a33bbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:14:00 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:14:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b92097a-09ff-40e6-a227-9fd5aa3c30b7]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG os_brick.utils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:14:00 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating existing volume attachment record: 512e0163-7228-431b-8749-4d304640c35c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:14:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:14:03 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216828.0879912, cef80969-a51d-46a1-a5b1-d510ecb97f81 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:03 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] VM Stopped (Lifecycle Event)
Aug 16 20:14:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-696d559d-9c8e-4285-a1a6-4375094a2f1a None None] [instance: cef80969-a51d-46a1-a5b1-d510ecb97f81] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:04 user nova-compute[72894]: INFO nova.compute.manager [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Unshelving
Aug 16 20:14:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_requests' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'numa_topology' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:04 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:14:04 user nova-compute[72894]: INFO nova.compute.claims [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Claim successful on node user
Aug 16 20:14:05 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:05 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:05 user nova-compute[72894]: INFO nova.network.neutron [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating port 4ae15471-0ba2-4aec-972a-3733caa98570 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing instance network info cache due to event network-changed-4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] Acquiring lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:14:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Creating image(s)
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] Acquired lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Refreshing network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG nova.virt.images [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] 698bc932-2657-468e-81b5-3fc72b59f934 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.part /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updated VIF entry in instance network info cache for port 4ae15471-0ba2-4aec-972a-3733caa98570. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7f2494db-073f-4829-8b42-c5694c11338f req-951a5a8f-18d3-40bb-bb5f-5a5cfed7c1f0 service nova] Releasing lock "refresh_cache-34d11735-e89e-4695-9ca5-d596a7b736b1" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.part /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.converted" returned: 0 in 0.636s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.206s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc,backing_fmt=raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc,backing_fmt=raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk 1073741824" returned: 0 in 0.052s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "57e7861e54fe043684999de7f5c1be8a1756f0bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'migration_context' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Rebasing disk image.
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.221s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f -F raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f -F raw /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk" returned: 0 in 2.680s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Ensure instance console log exists: /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start _get_guest_xml network_info=[{"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3b49c4a8178653f071cdd5edb836f30d',container_format='bare',created_at=2023-08-16T20:12:11Z,direct_url=<?>,disk_format='qcow2',id=698bc932-2657-468e-81b5-3fc72b59f934,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1251306969-shelved',owner='53a14259280244b3ad64ea5fb30ce7bf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T20:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:14:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3b49c4a8178653f071cdd5edb836f30d',container_format='bare',created_at=2023-08-16T20:12:11Z,direct_url=<?>,disk_format='qcow2',id=698bc932-2657-468e-81b5-3fc72b59f934,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1251306969-shelved',owner='53a14259280244b3ad64ea5fb30ce7bf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T20:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='698bc932-2657-468e-81b5-3fc72b59f934',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1947199152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:12:15.870358',shelved_host='user',shelved_image_id='698bc932-2657-468e-81b5-3fc72b59f934'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'pci_devices' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:14:12 user nova-compute[72894]:   <uuid>34d11735-e89e-4695-9ca5-d596a7b736b1</uuid>
Aug 16 20:14:12 user nova-compute[72894]:   <name>instance-0000001d</name>
Aug 16 20:14:12 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:14:12 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:14:12 user nova-compute[72894]:   <metadata>
Aug 16 20:14:12 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:14:12 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1251306969</nova:name>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:14:12</nova:creationTime>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:14:12 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:14:12 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:owner>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:user uuid="387415e40279468eaf69c06b271be2c9">tempest-AttachVolumeShelveTestJSON-1527512383-project-member</nova:user>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:project uuid="53a14259280244b3ad64ea5fb30ce7bf">tempest-AttachVolumeShelveTestJSON-1527512383</nova:project>
Aug 16 20:14:12 user nova-compute[72894]:       </nova:owner>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:root type="image" uuid="698bc932-2657-468e-81b5-3fc72b59f934"/>
Aug 16 20:14:12 user nova-compute[72894]:       <nova:ports>
Aug 16 20:14:12 user nova-compute[72894]:         <nova:port uuid="4ae15471-0ba2-4aec-972a-3733caa98570">
Aug 16 20:14:12 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 20:14:12 user nova-compute[72894]:         </nova:port>
Aug 16 20:14:12 user nova-compute[72894]:       </nova:ports>
Aug 16 20:14:12 user nova-compute[72894]:     </nova:instance>
Aug 16 20:14:12 user nova-compute[72894]:   </metadata>
Aug 16 20:14:12 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:14:12 user nova-compute[72894]:     <system>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="serial">34d11735-e89e-4695-9ca5-d596a7b736b1</entry>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="uuid">34d11735-e89e-4695-9ca5-d596a7b736b1</entry>
Aug 16 20:14:12 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:14:12 user nova-compute[72894]:     </system>
Aug 16 20:14:12 user nova-compute[72894]:   </sysinfo>
Aug 16 20:14:12 user nova-compute[72894]:   <os>
Aug 16 20:14:12 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:14:12 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:14:12 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:14:12 user nova-compute[72894]:   </os>
Aug 16 20:14:12 user nova-compute[72894]:   <features>
Aug 16 20:14:12 user nova-compute[72894]:     <acpi/>
Aug 16 20:14:12 user nova-compute[72894]:     <apic/>
Aug 16 20:14:12 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:14:12 user nova-compute[72894]:   </features>
Aug 16 20:14:12 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:14:12 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:14:12 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:14:12 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:14:12 user nova-compute[72894]:   </clock>
Aug 16 20:14:12 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:14:12 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:14:12 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:14:12 user nova-compute[72894]:   </cpu>
Aug 16 20:14:12 user nova-compute[72894]:   <devices>
Aug 16 20:14:12 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:14:12 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:14:12 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk"/>
Aug 16 20:14:12 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:14:12 user nova-compute[72894]:     </disk>
Aug 16 20:14:12 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:14:12 user nova-compute[72894]:       <mac address="fa:16:3e:b9:8e:77"/>
Aug 16 20:14:12 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:12 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:14:12 user nova-compute[72894]:       <target dev="tap4ae15471-0b"/>
Aug 16 20:14:12 user nova-compute[72894]:     </interface>
Aug 16 20:14:12 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:14:12 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/console.log" append="off"/>
Aug 16 20:14:12 user nova-compute[72894]:     </serial>
Aug 16 20:14:12 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:14:12 user nova-compute[72894]:     <video>
Aug 16 20:14:12 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:12 user nova-compute[72894]:     </video>
Aug 16 20:14:12 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:14:12 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:14:12 user nova-compute[72894]:     </rng>
Aug 16 20:14:12 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:14:12 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:14:12 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:14:12 user nova-compute[72894]:     </memballoon>
Aug 16 20:14:12 user nova-compute[72894]:   </devices>
Aug 16 20:14:12 user nova-compute[72894]: </domain>
Aug 16 20:14:12 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='698bc932-2657-468e-81b5-3fc72b59f934',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1947199152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member',shelved_at='2023-08-16T20:12:15.870358',shelved_host='user',shelved_image_id='698bc932-2657-468e-81b5-3fc72b59f934'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_vif [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae15471-0b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ae15471-0b, col_values=(('external_ids', {'iface-id': '4ae15471-0ba2-4aec-972a-3733caa98570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:8e:77', 'vm-uuid': '34d11735-e89e-4695-9ca5-d596a7b736b1'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZMuOcTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:14:12 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:14:12 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:14:12 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:12 user nova-compute[72894]: INFO os_vif [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b')
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed315e4-7cc5-4f32-82c2-daadc42882d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:14:12 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e8542-7ec7-469e-9fd0-b7247cc6219e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2] added
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] No VIF found with MAC fa:16:3e:b9:8e:77, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8cd191-bc4d-4df7-886c-4875bde2670f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c025e-2342-42f3-9ede-d66f15976e07]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZMuOcTD {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZMuOcTD" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f1019-dfe3-4d26-af31-e764388ef3e1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZMuOcTD'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8255a84-252c-4b04-9ce6-65b2365b4873]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178c2af-85f6-436e-9abc-12252b49c483]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c41ccc-f38f-4a7a-bfae-456d84b6fac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260]
Aug 16 20:14:12 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260] successful.
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce86ded-3c65-45d6-b1b2-978b95c9fef5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb42519-6a9b-4256-9cad-7f35aac7beb0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:12 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[37207378-fcd5-4ead-ba1a-e4633ba179cd]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:14:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZMuOcTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:14:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23432666661396633', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432666661396633', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG nova.objects.instance [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'flavor' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:14:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:14:14 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:14:14 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:14:14 user nova-compute[72894]:   <serial>8aacb8c8-4eef-4b3b-8f19-a817160225e2</serial>
Aug 16 20:14:14 user nova-compute[72894]: </disk>
Aug 16 20:14:14 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:ea:7b:2a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:14:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68e822e1-b693-4511-a7c8-ed59a3fac216 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.430s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid f3d00d19-bfc7-4b98-b468-7d06526e6124 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid d08b5d90-e83b-4894-8507-a5904a9f7098 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid fa5d9981-df95-4a41-995a-9c38396efc8b {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:16 user nova-compute[72894]: INFO nova.compute.manager [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Rescuing
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216857.1211069, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Resumed (Lifecycle Event)
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance spawned successfully.
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216857.1212146, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Started (Lifecycle Event)
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c3dec06c-514a-4607-8c17-8c0e4d470745 tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.911s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.988s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:17 user nova-compute[72894]: INFO nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:17 user nova-compute[72894]: WARNING nova.compute.manager [req-4e1899af-d46f-4a48-9ab1-45a60c04e1b9 req-a431edb1-f8ee-4397-82f6-d72299858f4c service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state active and task_state rescuing.
Aug 16 20:14:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance destroyed successfully.
Aug 16 20:14:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Attempting rescue
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:14:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Creating image(s)
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue" returned: 0 in 0.061s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'migration_context' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start _get_guest_xml network_info=[{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:ea:7b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '60545238-42c7-459f-80c0-4238accb7183', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'numa_topology' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334265123',display_name='tempest-ServerRescueNegativeTestJSON-server-1334265123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334265123',id=32,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8c+TxLZdyhgvXuBb333t0lKDfz6TZXsSOeTUL2YC40/onRwsDL/aUrDbBxX3xo9eKazQbgQdXbPFaHwm77Byu1mNEXyB+5/OmzBNaNRkNDnVWUfTZN3YwIov+4kALGFQ==',key_name='tempest-keypair-1836193020',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-40r73tjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be3a706becb041598d5a63714a389801',uuid=6d796fab-6318-4e7b-8a75-ecc4db1db2af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:ea:7b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "vif_mac": "fa:16:3e:ea:7b:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:14:18 user nova-compute[72894]:   <uuid>6d796fab-6318-4e7b-8a75-ecc4db1db2af</uuid>
Aug 16 20:14:18 user nova-compute[72894]:   <name>instance-00000020</name>
Aug 16 20:14:18 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:14:18 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:14:18 user nova-compute[72894]:   <metadata>
Aug 16 20:14:18 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:14:18 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1334265123</nova:name>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:14:18</nova:creationTime>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:14:18 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:14:18 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:owner>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:user uuid="be3a706becb041598d5a63714a389801">tempest-ServerRescueNegativeTestJSON-2142763307-project-member</nova:user>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:project uuid="14bb5629d37246269932266408249714">tempest-ServerRescueNegativeTestJSON-2142763307</nova:project>
Aug 16 20:14:18 user nova-compute[72894]:       </nova:owner>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:14:18 user nova-compute[72894]:       <nova:ports>
Aug 16 20:14:18 user nova-compute[72894]:         <nova:port uuid="8bbe259d-17fc-48f8-9ae2-748c2b92c28f">
Aug 16 20:14:18 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 20:14:18 user nova-compute[72894]:         </nova:port>
Aug 16 20:14:18 user nova-compute[72894]:       </nova:ports>
Aug 16 20:14:18 user nova-compute[72894]:     </nova:instance>
Aug 16 20:14:18 user nova-compute[72894]:   </metadata>
Aug 16 20:14:18 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:14:18 user nova-compute[72894]:     <system>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="serial">6d796fab-6318-4e7b-8a75-ecc4db1db2af</entry>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="uuid">6d796fab-6318-4e7b-8a75-ecc4db1db2af</entry>
Aug 16 20:14:18 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:14:18 user nova-compute[72894]:     </system>
Aug 16 20:14:18 user nova-compute[72894]:   </sysinfo>
Aug 16 20:14:18 user nova-compute[72894]:   <os>
Aug 16 20:14:18 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:14:18 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:14:18 user nova-compute[72894]:   </os>
Aug 16 20:14:18 user nova-compute[72894]:   <features>
Aug 16 20:14:18 user nova-compute[72894]:     <acpi/>
Aug 16 20:14:18 user nova-compute[72894]:     <apic/>
Aug 16 20:14:18 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:14:18 user nova-compute[72894]:   </features>
Aug 16 20:14:18 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:14:18 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:14:18 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:14:18 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:14:18 user nova-compute[72894]:   </clock>
Aug 16 20:14:18 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:14:18 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:14:18 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:14:18 user nova-compute[72894]:   </cpu>
Aug 16 20:14:18 user nova-compute[72894]:   <devices>
Aug 16 20:14:18 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:14:18 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:14:18 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue"/>
Aug 16 20:14:18 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:14:18 user nova-compute[72894]:     </disk>
Aug 16 20:14:18 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:14:18 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:14:18 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk"/>
Aug 16 20:14:18 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:14:18 user nova-compute[72894]:     </disk>
Aug 16 20:14:18 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:14:18 user nova-compute[72894]:       <mac address="fa:16:3e:ea:7b:2a"/>
Aug 16 20:14:18 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:18 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:14:18 user nova-compute[72894]:       <target dev="tap8bbe259d-17"/>
Aug 16 20:14:18 user nova-compute[72894]:     </interface>
Aug 16 20:14:18 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:14:18 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/console.log" append="off"/>
Aug 16 20:14:18 user nova-compute[72894]:     </serial>
Aug 16 20:14:18 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:14:18 user nova-compute[72894]:     <video>
Aug 16 20:14:18 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:18 user nova-compute[72894]:     </video>
Aug 16 20:14:18 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:14:18 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:14:18 user nova-compute[72894]:     </rng>
Aug 16 20:14:18 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:14:18 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:14:18 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:14:18 user nova-compute[72894]:     </memballoon>
Aug 16 20:14:18 user nova-compute[72894]:   </devices>
Aug 16 20:14:18 user nova-compute[72894]: </domain>
Aug 16 20:14:18 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:14:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance destroyed successfully.
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] No VIF found with MAC fa:16:3e:ea:7b:2a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:19 user nova-compute[72894]: WARNING nova.compute.manager [req-88638e09-0994-4dd4-a207-ccbe9cfbac75 req-4d16bae4-4b4c-44f2-ab35-52b4af8f162a service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state active and task_state rescuing.
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:20 user nova-compute[72894]: WARNING nova.compute.manager [req-6a17f351-8e0f-4ce4-a5a4-f391c5e6bb3f req-9782c705-6df7-4f43-b89b-7bbd58648c4c service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state active and task_state None.
Aug 16 20:14:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 6d796fab-6318-4e7b-8a75-ecc4db1db2af due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216862.5797179, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Resumed (Lifecycle Event)
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a96c2a78-39cb-41df-a357-d76511f2cf90 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216862.5820186, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:22 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Started (Lifecycle Event)
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:22 user nova-compute[72894]: WARNING nova.compute.manager [req-f671b26a-b8c7-4da8-b268-9b41f9c186c5 req-d544a0fa-170d-4ace-a281-7106069b1519 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state active and task_state None.
Aug 16 20:14:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:14:24 user nova-compute[72894]: INFO nova.compute.claims [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Claim successful on node user
Aug 16 20:14:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-changed-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Refreshing instance network info cache due to event network-changed-462a0396-50f6-4fe4-a3bf-2d091b647e08. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] Acquiring lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] Acquired lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:24 user nova-compute[72894]: DEBUG nova.network.neutron [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Refreshing network info cache for port 462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:25 user nova-compute[72894]: INFO nova.compute.manager [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Terminating instance
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.037s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.network.neutron [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updated VIF entry in instance network info cache for port 462a0396-50f6-4fe4-a3bf-2d091b647e08. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.network.neutron [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updating instance_info_cache with network_info: [{"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:25 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:14:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0546ffde-1de5-4838-b467-82532614f956 req-145b0a89-8cac-4ad2-b49e-68aeb9e7adae service nova] Releasing lock "refresh_cache-fa5d9981-df95-4a41-995a-9c38396efc8b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:14:25 user nova-compute[72894]: DEBUG nova.policy [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ec5f4494fff47b2aef65898afa8afa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb802770440441ca765afcbca83440e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:14:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Creating image(s)
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "/opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "/opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "/opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Instance destroyed successfully.
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid fa5d9981-df95-4a41-995a-9c38396efc8b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743186128',display_name='tempest-TestVolumeBootPattern-server-743186128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743186128',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-n3rvz36d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:12:57Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=fa5d9981-df95-4a41-995a-9c38396efc8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "address": "fa:16:3e:28:e6:e7", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a0396-50", "ovs_interfaceid": "462a0396-50f6-4fe4-a3bf-2d091b647e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_vif [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap462a0396-50, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:26 user nova-compute[72894]: INFO os_vif [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e6:e7,bridge_name='br-int',has_traffic_filtering=True,id=462a0396-50f6-4fe4-a3bf-2d091b647e08,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a0396-50')
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.236s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:14:26 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e6317-760e-43ea-a11e-1460f27b650a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6452c85-a0bc-48de-9801-229747a7f02a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:26 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79905d0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'): ({'sdf'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdf {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5655e9-b869-4c95-b204-1efff4ebe9d4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0a15a-34c6-47bf-9292-231265e70532]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdf {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eccbc72-5c21-47df-951e-2894a992a5f4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.310s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.073s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b00fed3-8c26-44f4-ab74-df4826444e08]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdf have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23963626639336361', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5432d50f', '/dev/disk/by-id/scsi-1SCST_BIO5432d50f-9cbf93caae2a9d3d') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d89def-140b-4603-a7fb-7256f81789ec]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk 1073741824" returned: 0 in 0.080s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fd136e-0325-495b-ad42-18cb5f058570]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Successfully created port: ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70fcfa-74f7-4915-8d7a-2b534fea5206]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]
Aug 16 20:14:26 user nova-compute[72894]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.
Aug 16 20:14:26 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5fe3a5-7512-4b0b-aabf-ea2cd883079d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.512s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (515ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:14:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Deleting instance files /opt/stack/data/nova/instances/fa5d9981-df95-4a41-995a-9c38396efc8b_del
Aug 16 20:14:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Deletion of /opt/stack/data/nova/instances/fa5d9981-df95-4a41-995a-9c38396efc8b_del complete
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:14:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:27 user nova-compute[72894]: WARNING nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state None.
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:27 user nova-compute[72894]: WARNING nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state None.
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-unplugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] No waiting events found dispatching network-vif-unplugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-unplugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Acquiring lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] No waiting events found dispatching network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:27 user nova-compute[72894]: WARNING nova.compute.manager [req-b93dd976-0217-411c-a2b7-2e1badcb07fd req-b87d8405-abdf-4286-8995-6f4aea0b9767 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received unexpected event network-vif-plugged-462a0396-50f6-4fe4-a3bf-2d091b647e08 for instance with vm_state active and task_state deleting.
Aug 16 20:14:27 user nova-compute[72894]: INFO nova.compute.manager [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Took 1.62 seconds to destroy the instance on the hypervisor.
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Cannot resize image /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'migration_context' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Ensure instance console log exists: /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Successfully updated port: ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquired lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing instance network info cache due to event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] Acquiring lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:14:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:28 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Took 1.00 seconds to deallocate network for instance.
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Releasing lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Instance network_info: |[{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] Acquired lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Start _get_guest_xml network_info=[{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:14:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2061280835',display_name='tempest-TestStampPattern-server-2061280835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2061280835',id=34,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-zb4jcug1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:14:26Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=f78d339d-1c1d-44e4-94f3-d9287767ce61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'pci_devices' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:14:28 user nova-compute[72894]:   <uuid>f78d339d-1c1d-44e4-94f3-d9287767ce61</uuid>
Aug 16 20:14:28 user nova-compute[72894]:   <name>instance-00000022</name>
Aug 16 20:14:28 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:14:28 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:14:28 user nova-compute[72894]:   <metadata>
Aug 16 20:14:28 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:14:28 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:name>tempest-TestStampPattern-server-2061280835</nova:name>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:14:28</nova:creationTime>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:14:28 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:14:28 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:owner>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:user uuid="5ec5f4494fff47b2aef65898afa8afa0">tempest-TestStampPattern-1667960248-project-member</nova:user>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:project uuid="5bb802770440441ca765afcbca83440e">tempest-TestStampPattern-1667960248</nova:project>
Aug 16 20:14:28 user nova-compute[72894]:       </nova:owner>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:14:28 user nova-compute[72894]:       <nova:ports>
Aug 16 20:14:28 user nova-compute[72894]:         <nova:port uuid="ab958e47-2e82-4ebc-a12a-566d5d43589b">
Aug 16 20:14:28 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 20:14:28 user nova-compute[72894]:         </nova:port>
Aug 16 20:14:28 user nova-compute[72894]:       </nova:ports>
Aug 16 20:14:28 user nova-compute[72894]:     </nova:instance>
Aug 16 20:14:28 user nova-compute[72894]:   </metadata>
Aug 16 20:14:28 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:14:28 user nova-compute[72894]:     <system>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="serial">f78d339d-1c1d-44e4-94f3-d9287767ce61</entry>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="uuid">f78d339d-1c1d-44e4-94f3-d9287767ce61</entry>
Aug 16 20:14:28 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:14:28 user nova-compute[72894]:     </system>
Aug 16 20:14:28 user nova-compute[72894]:   </sysinfo>
Aug 16 20:14:28 user nova-compute[72894]:   <os>
Aug 16 20:14:28 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:14:28 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:14:28 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:14:28 user nova-compute[72894]:   </os>
Aug 16 20:14:28 user nova-compute[72894]:   <features>
Aug 16 20:14:28 user nova-compute[72894]:     <acpi/>
Aug 16 20:14:28 user nova-compute[72894]:     <apic/>
Aug 16 20:14:28 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:14:28 user nova-compute[72894]:   </features>
Aug 16 20:14:28 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:14:28 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:14:28 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:14:28 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:14:28 user nova-compute[72894]:   </clock>
Aug 16 20:14:28 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:14:28 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:14:28 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:14:28 user nova-compute[72894]:   </cpu>
Aug 16 20:14:28 user nova-compute[72894]:   <devices>
Aug 16 20:14:28 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:14:28 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:14:28 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk"/>
Aug 16 20:14:28 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:14:28 user nova-compute[72894]:     </disk>
Aug 16 20:14:28 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:14:28 user nova-compute[72894]:       <mac address="fa:16:3e:ca:08:45"/>
Aug 16 20:14:28 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:28 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:14:28 user nova-compute[72894]:       <target dev="tapab958e47-2e"/>
Aug 16 20:14:28 user nova-compute[72894]:     </interface>
Aug 16 20:14:28 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:14:28 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/console.log" append="off"/>
Aug 16 20:14:28 user nova-compute[72894]:     </serial>
Aug 16 20:14:28 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:14:28 user nova-compute[72894]:     <video>
Aug 16 20:14:28 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:14:28 user nova-compute[72894]:     </video>
Aug 16 20:14:28 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:14:28 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:14:28 user nova-compute[72894]:     </rng>
Aug 16 20:14:28 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:14:28 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:14:28 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:14:28 user nova-compute[72894]:     </memballoon>
Aug 16 20:14:28 user nova-compute[72894]:   </devices>
Aug 16 20:14:28 user nova-compute[72894]: </domain>
Aug 16 20:14:28 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2061280835',display_name='tempest-TestStampPattern-server-2061280835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2061280835',id=34,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-zb4jcug1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:14:26Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=f78d339d-1c1d-44e4-94f3-d9287767ce61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG os_vif [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab958e47-2e, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab958e47-2e, col_values=(('external_ids', {'iface-id': 'ab958e47-2e82-4ebc-a12a-566d5d43589b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:08:45', 'vm-uuid': 'f78d339d-1c1d-44e4-94f3-d9287767ce61'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:28 user nova-compute[72894]: INFO os_vif [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e')
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No VIF found with MAC fa:16:3e:ca:08:45, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updated VIF entry in instance network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7b10961a-cb08-414e-aba2-18ed8df4a76e req-d201a683-c242-47e5-a966-7735cd99ebd6 service nova] Releasing lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:14:28 user nova-compute[72894]: INFO nova.compute.manager [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Took 0.82 seconds to detach 1 volumes for instance.
Aug 16 20:14:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-df7d65be-4301-49e2-804e-f5a88c59e760 req-dd65d748-42d6-407c-a8cd-6233bda0f5c9 service nova] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Received event network-vif-deleted-462a0396-50f6-4fe4-a3bf-2d091b647e08 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:29 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance fa5d9981-df95-4a41-995a-9c38396efc8b
Aug 16 20:14:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a57bbaab-d0ca-4f96-9d45-da9c71cb47b6 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "fa5d9981-df95-4a41-995a-9c38396efc8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.078s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] No waiting events found dispatching network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:29 user nova-compute[72894]: WARNING nova.compute.manager [req-30355e77-9d16-4d51-93a7-cdb4be28a4dd req-cafa70e7-276c-4f84-938e-c56811beb1e0 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received unexpected event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b for instance with vm_state building and task_state spawning.
Aug 16 20:14:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216872.0423877, f78d339d-1c1d-44e4-94f3-d9287767ce61 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] VM Resumed (Lifecycle Event)
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Instance spawned successfully.
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216872.0473022, f78d339d-1c1d-44e4-94f3-d9287767ce61 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] VM Started (Lifecycle Event)
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] No waiting events found dispatching network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:32 user nova-compute[72894]: WARNING nova.compute.manager [req-1922f813-bcf5-42ce-9658-119a5043ea42 req-f34b5e58-1bbc-423c-b5b0-1486430e99e7 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received unexpected event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b for instance with vm_state building and task_state spawning.
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 16 20:14:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:32 user nova-compute[72894]: INFO nova.compute.manager [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Took 7.64 seconds to build instance.
Aug 16 20:14:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f549d4ed-3817-46f3-869e-21366c75fe19 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.741s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:37 user nova-compute[72894]: INFO nova.compute.manager [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Terminating instance
Aug 16 20:14:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-77da19f7-ec30-414a-850a-e80972119fdd req-7ef7e303-b3d9-4ddc-82ae-e0db73458af9 service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-unplugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Instance destroyed successfully.
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid 9e018532-ae8e-4b6f-9931-18a006bdfc78 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461249139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461249139',id=26,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-kblycte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:12:52Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=9e018532-ae8e-4b6f-9931-18a006bdfc78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "address": "fa:16:3e:b9:b7:b9", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3b2f52-b6", "ovs_interfaceid": "3c3b2f52-b6a1-44d7-9f39-c9419db01724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_vif [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c3b2f52-b6, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:38 user nova-compute[72894]: INFO os_vif [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b7:b9,bridge_name='br-int',has_traffic_filtering=True,id=3c3b2f52-b6a1-44d7-9f39-c9419db01724,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3b2f52-b6')
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksSpUXEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:14:38 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef31ecc-0ddf-4cb6-a612-4bce93c5fc07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed6200-849d-42e6-8144-777e8f92f13c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:14:38 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:14:38 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c6952d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6df2c9-9568-4240-a9ec-81a540f4440f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29c2a53-aedb-4cd3-8a46-39a5ca1830fe]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94eb2b-3b78-487d-9c31-f7e30446835f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1a64d-1f4e-4c4b-9e6c-6cdd34375121]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c97413b-1cb5-4328-b14d-4c006990cc0c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1bc37-a393-4817-8f34-9df64e145c12]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260]
Aug 16 20:14:38 user nova-compute[72894]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06, portal: 172.16.0.220,3260] successful.
Aug 16 20:14:38 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb30a6-f3be-4a0a-94a4-c544dd233d06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c38533-2311-49a1-9960-f6390616ad44]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== disconnect_volume: return (344ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:14:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Deleting instance files /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78_del
Aug 16 20:14:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Deletion of /opt/stack/data/nova/instances/9e018532-ae8e-4b6f-9931-18a006bdfc78_del complete
Aug 16 20:14:38 user nova-compute[72894]: INFO nova.compute.manager [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 16 20:14:38 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:14:38 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:14:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:39 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:39 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Took 0.58 seconds to deallocate network for instance.
Aug 16 20:14:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-c0fff52a-42e6-42d5-b765-389f1a01982b req-bad9b678-a40f-4279-b6c1-8e5872b0a99f service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-deleted-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:39 user nova-compute[72894]: INFO nova.compute.manager [req-c0fff52a-42e6-42d5-b765-389f1a01982b req-bad9b678-a40f-4279-b6c1-8e5872b0a99f service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Neutron deleted interface 3c3b2f52-b6a1-44d7-9f39-c9419db01724; detaching it from the instance and deleting it from the info cache
Aug 16 20:14:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-c0fff52a-42e6-42d5-b765-389f1a01982b req-bad9b678-a40f-4279-b6c1-8e5872b0a99f service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-c0fff52a-42e6-42d5-b765-389f1a01982b req-bad9b678-a40f-4279-b6c1-8e5872b0a99f service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Detach interface failed, port_id=3c3b2f52-b6a1-44d7-9f39-c9419db01724, reason: Instance 9e018532-ae8e-4b6f-9931-18a006bdfc78 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:14:40 user nova-compute[72894]: INFO nova.compute.manager [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Took 0.90 seconds to detach 1 volumes for instance.
Aug 16 20:14:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] Acquiring lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] No waiting events found dispatching network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:40 user nova-compute[72894]: WARNING nova.compute.manager [req-c9b9a535-6f59-4f5b-b23e-294871137d8a req-dbf65b22-fe08-4aed-bbb5-2d3379be7d8b service nova] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Received unexpected event network-vif-plugged-3c3b2f52-b6a1-44d7-9f39-c9419db01724 for instance with vm_state active and task_state deleting.
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:40 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Deleted allocations for instance 9e018532-ae8e-4b6f-9931-18a006bdfc78
Aug 16 20:14:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2fb15c4c-63fb-4b90-8dbe-3b1bc3fe7a57 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "9e018532-ae8e-4b6f-9931-18a006bdfc78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:41 user nova-compute[72894]: INFO nova.compute.manager [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Terminating instance
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216866.255385, fa5d9981-df95-4a41-995a-9c38396efc8b => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] VM Stopped (Lifecycle Event)
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5f95e18c-cb7a-4354-9459-1aecb376a0bd None None] [instance: fa5d9981-df95-4a41-995a-9c38396efc8b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-unplugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] No waiting events found dispatching network-vif-unplugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-7211783c-4729-418e-abde-d4957a92f616 req-1c3da5fc-dd62-4c3c-b6ad-149d744d27b2 service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-unplugged-ee56abab-abe8-485f-a994-e4922696e53e for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:14:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Instance destroyed successfully.
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lazy-loading 'resources' on Instance uuid eee52fdd-dc11-4f58-9e51-483a6a771403 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-63241174',display_name='tempest-VolumesAdminNegativeTest-server-63241174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-63241174',id=24,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTnH/uqkMIIqdhx3/UuDr1+xAF7LIVbDoVP02LdjUVk8ySE8hOfysatmcDSprV8QaMj5tj+PkqutKmw98JLB9oZDPio+R6MSpoyKF7It/pNcu6OmBWBcZOarg0svNwZiA==',key_name='tempest-keypair-791501675',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='564438a58fc64bf2b60d95f4c3eb0fe8',ramdisk_id='',reservation_id='r-1ugq4x0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1980072019',owner_user_name='tempest-VolumesAdminNegativeTest-1980072019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7b74284f2c24d79bc01434de253ae70',uuid=eee52fdd-dc11-4f58-9e51-483a6a771403,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converting VIF {"id": "ee56abab-abe8-485f-a994-e4922696e53e", "address": "fa:16:3e:7e:e2:cb", "network": {"id": "d22f034e-732b-413e-9d26-0247e2ca72bd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640440580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "564438a58fc64bf2b60d95f4c3eb0fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee56abab-ab", "ovs_interfaceid": "ee56abab-abe8-485f-a994-e4922696e53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG os_vif [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee56abab-ab, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:42 user nova-compute[72894]: INFO os_vif [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e2:cb,bridge_name='br-int',has_traffic_filtering=True,id=ee56abab-abe8-485f-a994-e4922696e53e,network=Network(d22f034e-732b-413e-9d26-0247e2ca72bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee56abab-ab')
Aug 16 20:14:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Deleting instance files /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403_del
Aug 16 20:14:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Deletion of /opt/stack/data/nova/instances/eee52fdd-dc11-4f58-9e51-483a6a771403_del complete
Aug 16 20:14:42 user nova-compute[72894]: INFO nova.compute.manager [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 20:14:42 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:14:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:14:43 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Took 1.17 seconds to deallocate network for instance.
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] Acquiring lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] No waiting events found dispatching network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:14:43 user nova-compute[72894]: WARNING nova.compute.manager [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received unexpected event network-vif-plugged-ee56abab-abe8-485f-a994-e4922696e53e for instance with vm_state deleted and task_state None.
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-9c37b1a8-f514-4660-bed8-bd5db7e6f15c req-da59fe5e-2956-417c-a2c4-010c1f11510f service nova] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Received event network-vif-deleted-ee56abab-abe8-485f-a994-e4922696e53e {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:43 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Deleted allocations for instance eee52fdd-dc11-4f58-9e51-483a6a771403
Aug 16 20:14:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e67f344e-0de5-44bf-aca4-e807b4b5bea7 tempest-VolumesAdminNegativeTest-1980072019 tempest-VolumesAdminNegativeTest-1980072019-project-member] Lock "eee52fdd-dc11-4f58-9e51-483a6a771403" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:44 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:14:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:48 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7145MB free_disk=24.054088592529297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance d08b5d90-e83b-4894-8507-a5904a9f7098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 34d11735-e89e-4695-9ca5-d596a7b736b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:14:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:14:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:14:49 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:14:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:14:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:14:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:14:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:14:53 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216878.222205, 9e018532-ae8e-4b6f-9931-18a006bdfc78 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:53 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] VM Stopped (Lifecycle Event)
Aug 16 20:14:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-64de9746-6a3b-43ad-9f3f-61ff407fd796 None None] [instance: 9e018532-ae8e-4b6f-9931-18a006bdfc78] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:53 user nova-compute[72894]: INFO nova.compute.manager [None req-38490498-5e6e-43a0-80f7-f26589af18e7 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Get console output
Aug 16 20:14:53 user nova-compute[72894]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 20:14:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:57 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216882.0338902, eee52fdd-dc11-4f58-9e51-483a6a771403 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:14:57 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] VM Stopped (Lifecycle Event)
Aug 16 20:14:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5c81eaa5-e9dc-4be2-9511-9113edb28975 None None] [instance: eee52fdd-dc11-4f58-9e51-483a6a771403] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:14:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:14:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing instance network info cache due to event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updated VIF entry in instance network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-962ae462-cb76-4a9f-80eb-b2443b2f2988 req-0443abf5-6036-4051-92f2-8472adbab9a9 service nova] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:10 user nova-compute[72894]: INFO nova.compute.manager [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Detaching volume 3303ecdc-9f43-41db-8c1e-1a67080a89db
Aug 16 20:15:10 user nova-compute[72894]: INFO nova.virt.block_device [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Attempting to driver detach volume 3303ecdc-9f43-41db-8c1e-1a67080a89db from mountpoint /dev/vdb
Aug 16 20:15:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Attempting to detach device vdb from instance e3fa3ace-3292-4957-aa6a-98f14b12795f from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:15:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:15:10 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:15:10 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:15:10 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:15:10 user nova-compute[72894]:   <serial>3303ecdc-9f43-41db-8c1e-1a67080a89db</serial>
Aug 16 20:15:10 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:15:10 user nova-compute[72894]: </disk>
Aug 16 20:15:10 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:15:11 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully detached device vdb from instance e3fa3ace-3292-4957-aa6a-98f14b12795f from the persistent domain config.
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3fa3ace-3292-4957-aa6a-98f14b12795f from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:15:11 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:15:11 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:15:11 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:15:11 user nova-compute[72894]:   <serial>3303ecdc-9f43-41db-8c1e-1a67080a89db</serial>
Aug 16 20:15:11 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:15:11 user nova-compute[72894]: </disk>
Aug 16 20:15:11 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216911.3996875, e3fa3ace-3292-4957-aa6a-98f14b12795f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:15:11 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully detached device vdb from instance e3fa3ace-3292-4957-aa6a-98f14b12795f from the live domain config.
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odKnJetC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:15:11 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2fc52-a8d8-4f7c-a3f4-e618e43621b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184995d-5a02-4f3e-b38d-1b2cf6e98016]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:11 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db (non-flash)
Aug 16 20:15:11 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:11 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990486dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05f3dd-c01a-4567-9398-85048a3042ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304a38a-c5c8-48a3-b470-2fad729ad4e5]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d7d16-4208-4451-bd68-f3d8f00fb4e7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ea0ee-ba84-4022-af0d-0eeab0e112f9]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c209abe-3a5a-44dd-b9a6-014ea181d753]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bca804-fb46-42d5-ad64-c0ee33ee6a15]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260]
Aug 16 20:15:11 user nova-compute[72894]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db, portal: 172.16.0.220,3260] successful.
Aug 16 20:15:11 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3303ecdc-9f43-41db-8c1e-1a67080a89db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c18e63d-ca2a-4cb0-aad6-529e3c61ccb8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== disconnect_volume: return (281ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing instance network info cache due to event network-changed-22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] Acquiring lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] Acquired lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:11 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Refreshing network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updated VIF entry in instance network info cache for port 22bcca30-6f46-415c-be4a-92cb214928e8. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [{"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8da6ea65-338c-47ef-ba54-336d9be7d706 req-94db0dce-f60d-4e69-8f90-e9378342523f service nova] Releasing lock "refresh_cache-e3fa3ace-3292-4957-aa6a-98f14b12795f" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b9d939cf-5092-44dd-978c-86c44606f473 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:15:17 user nova-compute[72894]: INFO nova.compute.claims [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Claim successful on node user
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:15:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:15:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:15:18 user nova-compute[72894]: INFO nova.virt.block_device [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Booting with volume 733e6986-36f7-483c-93f7-f6bae2b4ff2d at /dev/vda
Aug 16 20:15:18 user nova-compute[72894]: DEBUG nova.policy [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.utils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef8588e-ec17-4f54-825e-f775ab5b7cc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6517541-03f9-4550-82b3-b09b101fbb99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c25585a-eca3-41a5-84b8-1ddf2fe749aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6717c-2053-45e1-a654-08100f767624]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:15:18 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:15:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b25ccc5-0754-4ab3-997a-d5dd914e9375]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG os_brick.utils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating existing volume attachment record: 531e0fb3-b665-4b67-bc44-cf7261a1e2d0 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:15:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Successfully created port: 1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Successfully updated port: 1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing instance network info cache due to event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] Acquiring lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Instance network_info: |[{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] Acquired lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:19 user nova-compute[72894]: DEBUG nova.network.neutron [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:15:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updated VIF entry in instance network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:15:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4cde437f-31f2-4ef7-9775-5d1e29398e5e req-4e64e283-7670-4ac8-91d5-a20672047dc6 service nova] Releasing lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:28 user nova-compute[72894]: INFO nova.compute.manager [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Terminating instance
Aug 16 20:15:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-unplugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] No waiting events found dispatching network-vif-unplugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-72dd6073-bc99-4e16-a83b-3146436fb023 req-d6e615f4-a79e-4216-bbc4-4eb2e5833f28 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-unplugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:15:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Creating image(s)
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/60cd43b9-f661-4a6f-a791-1969f5b66f8d/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Start _get_guest_xml network_info=[{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '531e0fb3-b665-4b67-bc44-cf7261a1e2d0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60cd43b9-f661-4a6f-a791-1969f5b66f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '733e6986-36f7-483c-93f7-f6bae2b4ff2d', 'serial': '733e6986-36f7-483c-93f7-f6bae2b4ff2d'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:15:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:15:29 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:15:29 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:15:29 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[802237d9-afc0-477c-9ac9-e7494101396d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:15:29 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba194b-191e-49ae-a4bf-c9493748ecd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d] added
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7c59e-5690-477c-ae26-9a5a210a39a9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec084c-64e0-4f2a-8383-7271d512f8dd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQDhdtrL {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQDhdtrL" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3aebd-03f1-4e0f-b678-899baf0b77e8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQDhdtrL'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c7304-b634-4251-ace8-d87af34c45b6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2714e412-8dc3-402f-8972-259489fefe49]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[399db930-b45d-4da0-ab9d-a0fdb99317fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]
Aug 16 20:15:29 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9d00e-1dba-48d0-bf44-884a174ad75c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac83805-fed3-4948-ab0f-8d3791a98e14]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:29 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:15:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbf7520-379b-437b-9d5d-84581906efb5]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:15:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Instance destroyed successfully.
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid d08b5d90-e83b-4894-8507-a5904a9f7098 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-515326161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-515326161',id=21,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-a6svgju6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:08:02Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=d08b5d90-e83b-4894-8507-a5904a9f7098,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "address": "fa:16:3e:6a:6d:d1", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf064b8-7b", "ovs_interfaceid": "2cf064b8-7baf-40d3-94d8-d8d1670f7b2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG os_vif [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf064b8-7b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:29 user nova-compute[72894]: INFO os_vif [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6d:d1,bridge_name='br-int',has_traffic_filtering=True,id=2cf064b8-7baf-40d3-94d8-d8d1670f7b2d,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf064b8-7b')
Aug 16 20:15:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Deleting instance files /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098_del
Aug 16 20:15:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Deletion of /opt/stack/data/nova/instances/d08b5d90-e83b-4894-8507-a5904a9f7098_del complete
Aug 16 20:15:29 user nova-compute[72894]: INFO nova.compute.manager [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 20:15:29 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:15:29 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:30 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Took 0.54 seconds to deallocate network for instance.
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-1ddc5d4a-f23c-416a-a910-58a67bdc1e20 req-069f4f6c-c579-4cc8-ae3c-2def96295430 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-deleted-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23963626639336361', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963626639336361', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592000340',display_name='tempest-TestVolumeBootPattern-server-1592000340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592000340',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-i5tgxqhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:15:18Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=60cd43b9-f661-4a6f-a791-1969f5b66f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid 60cd43b9-f661-4a6f-a791-1969f5b66f8d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:15:30 user nova-compute[72894]:   <uuid>60cd43b9-f661-4a6f-a791-1969f5b66f8d</uuid>
Aug 16 20:15:30 user nova-compute[72894]:   <name>instance-00000023</name>
Aug 16 20:15:30 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:15:30 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:15:30 user nova-compute[72894]:   <metadata>
Aug 16 20:15:30 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:15:30 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:15:30 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-server-1592000340</nova:name>
Aug 16 20:15:30 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:15:29</nova:creationTime>
Aug 16 20:15:30 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:15:30 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:15:30 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:15:30 user nova-compute[72894]:       <nova:owner>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:15:30 user nova-compute[72894]:       </nova:owner>
Aug 16 20:15:30 user nova-compute[72894]:       <nova:ports>
Aug 16 20:15:30 user nova-compute[72894]:         <nova:port uuid="1f9ce887-51bb-4d6a-b40d-045d82f93b25">
Aug 16 20:15:30 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 20:15:30 user nova-compute[72894]:         </nova:port>
Aug 16 20:15:30 user nova-compute[72894]:       </nova:ports>
Aug 16 20:15:30 user nova-compute[72894]:     </nova:instance>
Aug 16 20:15:30 user nova-compute[72894]:   </metadata>
Aug 16 20:15:30 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:15:30 user nova-compute[72894]:     <system>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="serial">60cd43b9-f661-4a6f-a791-1969f5b66f8d</entry>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="uuid">60cd43b9-f661-4a6f-a791-1969f5b66f8d</entry>
Aug 16 20:15:30 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:15:30 user nova-compute[72894]:     </system>
Aug 16 20:15:30 user nova-compute[72894]:   </sysinfo>
Aug 16 20:15:30 user nova-compute[72894]:   <os>
Aug 16 20:15:30 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:15:30 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:15:30 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:15:30 user nova-compute[72894]:   </os>
Aug 16 20:15:30 user nova-compute[72894]:   <features>
Aug 16 20:15:30 user nova-compute[72894]:     <acpi/>
Aug 16 20:15:30 user nova-compute[72894]:     <apic/>
Aug 16 20:15:30 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:15:30 user nova-compute[72894]:   </features>
Aug 16 20:15:30 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:15:30 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:15:30 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:15:30 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:15:30 user nova-compute[72894]:   </clock>
Aug 16 20:15:30 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:15:30 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:15:30 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:15:30 user nova-compute[72894]:   </cpu>
Aug 16 20:15:30 user nova-compute[72894]:   <devices>
Aug 16 20:15:30 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:15:30 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:15:30 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 20:15:30 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:15:30 user nova-compute[72894]:       <serial>733e6986-36f7-483c-93f7-f6bae2b4ff2d</serial>
Aug 16 20:15:30 user nova-compute[72894]:     </disk>
Aug 16 20:15:30 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:15:30 user nova-compute[72894]:       <mac address="fa:16:3e:87:25:0d"/>
Aug 16 20:15:30 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:15:30 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:15:30 user nova-compute[72894]:       <target dev="tap1f9ce887-51"/>
Aug 16 20:15:30 user nova-compute[72894]:     </interface>
Aug 16 20:15:30 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:15:30 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/60cd43b9-f661-4a6f-a791-1969f5b66f8d/console.log" append="off"/>
Aug 16 20:15:30 user nova-compute[72894]:     </serial>
Aug 16 20:15:30 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:15:30 user nova-compute[72894]:     <video>
Aug 16 20:15:30 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:15:30 user nova-compute[72894]:     </video>
Aug 16 20:15:30 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:15:30 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:15:30 user nova-compute[72894]:     </rng>
Aug 16 20:15:30 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:15:30 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:15:30 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:15:30 user nova-compute[72894]:     </memballoon>
Aug 16 20:15:30 user nova-compute[72894]:   </devices>
Aug 16 20:15:30 user nova-compute[72894]: </domain>
Aug 16 20:15:30 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592000340',display_name='tempest-TestVolumeBootPattern-server-1592000340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592000340',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-i5tgxqhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:15:18Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=60cd43b9-f661-4a6f-a791-1969f5b66f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG os_vif [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f9ce887-51, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f9ce887-51, col_values=(('external_ids', {'iface-id': '1f9ce887-51bb-4d6a-b40d-045d82f93b25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:25:0d', 'vm-uuid': '60cd43b9-f661-4a6f-a791-1969f5b66f8d'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:30 user nova-compute[72894]: INFO os_vif [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51')
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:15:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:87:25:0d, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:15:30 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Deleted allocations for instance d08b5d90-e83b-4894-8507-a5904a9f7098
Aug 16 20:15:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7f3076e7-ed96-4f49-861d-a0c9c5a184f5 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] Acquiring lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] Lock "d08b5d90-e83b-4894-8507-a5904a9f7098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] No waiting events found dispatching network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:31 user nova-compute[72894]: WARNING nova.compute.manager [req-c763051b-6cf7-400d-8c82-bc94f54c116e req-491fddaf-c4f6-4fde-bf0d-0ae62f15db55 service nova] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Received unexpected event network-vif-plugged-2cf064b8-7baf-40d3-94d8-d8d1670f7b2d for instance with vm_state deleted and task_state None.
Aug 16 20:15:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] No waiting events found dispatching network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:33 user nova-compute[72894]: WARNING nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received unexpected event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 for instance with vm_state building and task_state spawning.
Aug 16 20:15:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] No waiting events found dispatching network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:33 user nova-compute[72894]: WARNING nova.compute.manager [req-d29e9b1d-68f5-4c53-a4eb-10743f7fcc3b req-1c869d3d-4024-42b1-be0b-d0894748c326 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received unexpected event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 for instance with vm_state building and task_state spawning.
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216934.0500894, 60cd43b9-f661-4a6f-a791-1969f5b66f8d => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] VM Resumed (Lifecycle Event)
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Instance spawned successfully.
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216934.0511715, 60cd43b9-f661-4a6f-a791-1969f5b66f8d => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] VM Started (Lifecycle Event)
Aug 16 20:15:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 16 20:15:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:34 user nova-compute[72894]: INFO nova.compute.manager [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Took 16.91 seconds to build instance.
Aug 16 20:15:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1af9bf1a-c607-4391-bc0f-72132c634e2f tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.035s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216929.5279498, d08b5d90-e83b-4894-8507-a5904a9f7098 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:15:44 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] VM Stopped (Lifecycle Event)
Aug 16 20:15:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3811b56c-701c-42ee-964f-ce6ebb40780b None None] [instance: d08b5d90-e83b-4894-8507-a5904a9f7098] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [{"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-5ac6a4fb-e267-4273-930d-54f6b20e1d03" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:49 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=24.132553100585938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 133d92d6-70ca-4d7e-90d1-4edd276e716f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e3fa3ace-3292-4957-aa6a-98f14b12795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 34d11735-e89e-4695-9ca5-d596a7b736b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:15:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:15:50 user nova-compute[72894]: INFO nova.compute.claims [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Claim successful on node user
Aug 16 20:15:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:15:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:15:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.policy [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30c3a1069dde434c8a1e9493e2c493d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae53333457144c0930deb3f59ae9ad1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:15:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Creating image(s)
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "/opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "/opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk 1073741824" returned: 0 in 0.049s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Successfully created port: 1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Cannot resize image /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lazy-loading 'migration_context' on Instance uuid c4ea94f8-a824-49ae-9671-3dd1d2747423 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Ensure instance console log exists: /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Successfully updated port: 1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquired lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-changed-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Refreshing instance network info cache due to event network-changed-1f4ba607-9a2d-4458-bd7d-2833a6f3480a. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] Acquiring lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:15:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Updating instance_info_cache with network_info: [{"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Releasing lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Instance network_info: |[{"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] Acquired lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Refreshing network info cache for port 1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Start _get_guest_xml network_info=[{"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:15:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1814657161',display_name='tempest-DeleteServersTestJSON-server-1814657161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1814657161',id=36,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aae53333457144c0930deb3f59ae9ad1',ramdisk_id='',reservation_id='r-di9a9vzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-238489581',owner_user_name='tempest-DeleteServersTestJSON-238489581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:15:51Z,user_data=None,user_id='30c3a1069dde434c8a1e9493e2c493d2',uuid=c4ea94f8-a824-49ae-9671-3dd1d2747423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converting VIF {"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lazy-loading 'pci_devices' on Instance uuid c4ea94f8-a824-49ae-9671-3dd1d2747423 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:15:53 user nova-compute[72894]:   <uuid>c4ea94f8-a824-49ae-9671-3dd1d2747423</uuid>
Aug 16 20:15:53 user nova-compute[72894]:   <name>instance-00000024</name>
Aug 16 20:15:53 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:15:53 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:15:53 user nova-compute[72894]:   <metadata>
Aug 16 20:15:53 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:15:53 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:name>tempest-DeleteServersTestJSON-server-1814657161</nova:name>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:15:53</nova:creationTime>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:15:53 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:15:53 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:owner>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:user uuid="30c3a1069dde434c8a1e9493e2c493d2">tempest-DeleteServersTestJSON-238489581-project-member</nova:user>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:project uuid="aae53333457144c0930deb3f59ae9ad1">tempest-DeleteServersTestJSON-238489581</nova:project>
Aug 16 20:15:53 user nova-compute[72894]:       </nova:owner>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:15:53 user nova-compute[72894]:       <nova:ports>
Aug 16 20:15:53 user nova-compute[72894]:         <nova:port uuid="1f4ba607-9a2d-4458-bd7d-2833a6f3480a">
Aug 16 20:15:53 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 20:15:53 user nova-compute[72894]:         </nova:port>
Aug 16 20:15:53 user nova-compute[72894]:       </nova:ports>
Aug 16 20:15:53 user nova-compute[72894]:     </nova:instance>
Aug 16 20:15:53 user nova-compute[72894]:   </metadata>
Aug 16 20:15:53 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:15:53 user nova-compute[72894]:     <system>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="serial">c4ea94f8-a824-49ae-9671-3dd1d2747423</entry>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="uuid">c4ea94f8-a824-49ae-9671-3dd1d2747423</entry>
Aug 16 20:15:53 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:15:53 user nova-compute[72894]:     </system>
Aug 16 20:15:53 user nova-compute[72894]:   </sysinfo>
Aug 16 20:15:53 user nova-compute[72894]:   <os>
Aug 16 20:15:53 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:15:53 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:15:53 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:15:53 user nova-compute[72894]:   </os>
Aug 16 20:15:53 user nova-compute[72894]:   <features>
Aug 16 20:15:53 user nova-compute[72894]:     <acpi/>
Aug 16 20:15:53 user nova-compute[72894]:     <apic/>
Aug 16 20:15:53 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:15:53 user nova-compute[72894]:   </features>
Aug 16 20:15:53 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:15:53 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:15:53 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:15:53 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:15:53 user nova-compute[72894]:   </clock>
Aug 16 20:15:53 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:15:53 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:15:53 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:15:53 user nova-compute[72894]:   </cpu>
Aug 16 20:15:53 user nova-compute[72894]:   <devices>
Aug 16 20:15:53 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:15:53 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:15:53 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk"/>
Aug 16 20:15:53 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:15:53 user nova-compute[72894]:     </disk>
Aug 16 20:15:53 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:15:53 user nova-compute[72894]:       <mac address="fa:16:3e:61:6b:53"/>
Aug 16 20:15:53 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:15:53 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:15:53 user nova-compute[72894]:       <target dev="tap1f4ba607-9a"/>
Aug 16 20:15:53 user nova-compute[72894]:     </interface>
Aug 16 20:15:53 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:15:53 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/console.log" append="off"/>
Aug 16 20:15:53 user nova-compute[72894]:     </serial>
Aug 16 20:15:53 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:15:53 user nova-compute[72894]:     <video>
Aug 16 20:15:53 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:15:53 user nova-compute[72894]:     </video>
Aug 16 20:15:53 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:15:53 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:15:53 user nova-compute[72894]:     </rng>
Aug 16 20:15:53 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:15:53 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:15:53 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:15:53 user nova-compute[72894]:     </memballoon>
Aug 16 20:15:53 user nova-compute[72894]:   </devices>
Aug 16 20:15:53 user nova-compute[72894]: </domain>
Aug 16 20:15:53 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1814657161',display_name='tempest-DeleteServersTestJSON-server-1814657161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1814657161',id=36,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aae53333457144c0930deb3f59ae9ad1',ramdisk_id='',reservation_id='r-di9a9vzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-238489581',owner_user_name='tempest-DeleteServersTestJSON-238489581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:15:51Z,user_data=None,user_id='30c3a1069dde434c8a1e9493e2c493d2',uuid=c4ea94f8-a824-49ae-9671-3dd1d2747423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converting VIF {"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG os_vif [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4ba607-9a, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f4ba607-9a, col_values=(('external_ids', {'iface-id': '1f4ba607-9a2d-4458-bd7d-2833a6f3480a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:6b:53', 'vm-uuid': 'c4ea94f8-a824-49ae-9671-3dd1d2747423'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:53 user nova-compute[72894]: INFO os_vif [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a')
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] No VIF found with MAC fa:16:3e:61:6b:53, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Updated VIF entry in instance network info cache for port 1f4ba607-9a2d-4458-bd7d-2833a6f3480a. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.network.neutron [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Updating instance_info_cache with network_info: [{"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d0e690d0-a22d-4f13-a72e-e5128c2211bb req-cb46c833-d8a3-46be-b34c-9aad1d7ee44d service nova] Releasing lock "refresh_cache-c4ea94f8-a824-49ae-9671-3dd1d2747423" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:54 user nova-compute[72894]: INFO nova.compute.manager [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Terminating instance
Aug 16 20:15:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-e22404e1-02aa-4728-ad8f-2c0d8b217f99 req-c8d121b1-b503-442b-ba98-ec2c0a28ab88 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-unplugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.compute.manager [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Terminating instance
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Instance destroyed successfully.
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'resources' on Instance uuid 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-962766217',display_name='tempest-ServerActionsTestOtherA-server-962766217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-962766217',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-0155ova8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=4f4bb0f9-a9ca-4bde-ae50-fd20e768d355,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "41a97b77-d117-472e-8d2b-524454350c6b", "address": "fa:16:3e:cb:2f:e1", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a97b77-d1", "ovs_interfaceid": "41a97b77-d117-472e-8d2b-524454350c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_vif [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-75f0b97c-4209-4d68-b0fd-e5c2112ad4e8 req-680a00f9-aad3-45be-b837-3ef19ef7e740 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-unplugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41a97b77-d1, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: INFO os_vif [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:e1,bridge_name='br-int',has_traffic_filtering=True,id=41a97b77-d117-472e-8d2b-524454350c6b,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a97b77-d1')
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfiNrAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:15:55 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[52385d44-f72f-47d2-b410-8698cac28bb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba6afe-3d19-402e-b0b3-8bbd9390da48]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:15:55 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:15:55 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:15:55 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79904c25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd4cc3-bc38-462a-bde9-a2df792527b7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c29ce-a24d-4f3f-9b08-2d9f46fcc177]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a69fc-550b-479a-b83b-a9830de2a4e9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f154b655-3343-49b1-aa0c-5242cfb39394]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2eca02-ffea-41f6-bae3-bd07db8917f6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b93e867-3141-4da0-bc9b-039acdd069d4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260]
Aug 16 20:15:55 user nova-compute[72894]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc, portal: 172.16.0.220,3260] successful.
Aug 16 20:15:55 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2886717-52f0-4bd3-b46d-2b0c7996cbfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59ca2d-9b72-4b87-9712-ade80f01c0ff]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] <== disconnect_volume: return (380ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Deleting instance files /opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355_del
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Deletion of /opt/stack/data/nova/instances/4f4bb0f9-a9ca-4bde-ae50-fd20e768d355_del complete
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Instance destroyed successfully.
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.objects.instance [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lazy-loading 'resources' on Instance uuid 34d11735-e89e-4695-9ca5-d596a7b736b1 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1251306969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1251306969',id=29,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXqJQ3OSCxbhn6FeS/X4MuALkvHiA46IOCQJPAvjaSPbelmIfJEP+4QzoIOU8aU8a/gxD1LBAsiurn0QfipO/CiOmj55xCkUnEmbwylWMUBJ3smZpDdgTOOOhgqapdI0Q==',key_name='tempest-keypair-1947199152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53a14259280244b3ad64ea5fb30ce7bf',ramdisk_id='',reservation_id='r-1m2ifkda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527512383',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527512383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387415e40279468eaf69c06b271be2c9',uuid=34d11735-e89e-4695-9ca5-d596a7b736b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converting VIF {"id": "4ae15471-0ba2-4aec-972a-3733caa98570", "address": "fa:16:3e:b9:8e:77", "network": {"id": "2662e9f6-dfeb-4da7-9ab9-cd0a8d327479", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-924746189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53a14259280244b3ad64ea5fb30ce7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae15471-0b", "ovs_interfaceid": "4ae15471-0ba2-4aec-972a-3733caa98570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG os_vif [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae15471-0b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:15:55 user nova-compute[72894]: INFO os_vif [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8e:77,bridge_name='br-int',has_traffic_filtering=True,id=4ae15471-0ba2-4aec-972a-3733caa98570,network=Network(2662e9f6-dfeb-4da7-9ab9-cd0a8d327479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae15471-0b')
Aug 16 20:15:55 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Deleting instance files /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1_del
Aug 16 20:15:56 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Deletion of /opt/stack/data/nova/instances/34d11735-e89e-4695-9ca5-d596a7b736b1_del complete
Aug 16 20:15:56 user nova-compute[72894]: INFO nova.compute.manager [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Took 1.84 seconds to destroy the instance on the hypervisor.
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:15:56 user nova-compute[72894]: INFO nova.compute.manager [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Acquiring lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] No waiting events found dispatching network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:56 user nova-compute[72894]: WARNING nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received unexpected event network-vif-plugged-41a97b77-d117-472e-8d2b-524454350c6b for instance with vm_state active and task_state deleting.
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] No waiting events found dispatching network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:56 user nova-compute[72894]: WARNING nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received unexpected event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a for instance with vm_state building and task_state spawning.
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] No waiting events found dispatching network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:56 user nova-compute[72894]: WARNING nova.compute.manager [req-ad98ab53-90fb-48e0-85a2-ec1909ffe6e3 req-95efa784-35d1-4c4a-a3a3-bda3ab77793c service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received unexpected event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a for instance with vm_state building and task_state spawning.
Aug 16 20:15:56 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:56 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Took 0.82 seconds to deallocate network for instance.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Took 0.98 seconds to deallocate network for instance.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216957.372047, c4ea94f8-a824-49ae-9671-3dd1d2747423 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] VM Resumed (Lifecycle Event)
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Instance spawned successfully.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216957.3747768, c4ea94f8-a824-49ae-9671-3dd1d2747423 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] VM Started (Lifecycle Event)
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] Acquiring lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] No waiting events found dispatching network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:15:57 user nova-compute[72894]: WARNING nova.compute.manager [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received unexpected event network-vif-plugged-4ae15471-0ba2-4aec-972a-3733caa98570 for instance with vm_state deleted and task_state None.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-bc5b9374-44d5-476a-b481-abc42f87ecb1 req-bc5dfd50-a530-40bf-95af-62a9535a94e1 service nova] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Received event network-vif-deleted-41a97b77-d117-472e-8d2b-524454350c6b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Deleted allocations for instance 34d11735-e89e-4695-9ca5-d596a7b736b1
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Took 7.23 seconds to build instance.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71a45a47-8582-4249-96f7-e7a141e2ee5f tempest-AttachVolumeShelveTestJSON-1527512383 tempest-AttachVolumeShelveTestJSON-1527512383-project-member] Lock "34d11735-e89e-4695-9ca5-d596a7b736b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8797956-43fe-4d5f-ac5c-b6a62bf9e9d9 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.327s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:57 user nova-compute[72894]: INFO nova.compute.manager [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Took 0.79 seconds to detach 1 volumes for instance.
Aug 16 20:15:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Deleting volume: b2886717-52f0-4bd3-b46d-2b0c7996cbfc {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:15:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:15:58 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:15:58 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:15:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:58 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Deleted allocations for instance 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355
Aug 16 20:15:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f3bfd627-40df-499a-97cf-2f4d7c478bca tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "4f4bb0f9-a9ca-4bde-ae50-fd20e768d355" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.109s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:15:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-5cab7b3c-a05c-4640-ae91-0c3e1998c33b req-075d8a52-5769-4cc3-a238-10f961f5ed28 service nova] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Received event network-vif-deleted-4ae15471-0ba2-4aec-972a-3733caa98570 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:15:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:07 user nova-compute[72894]: INFO nova.compute.manager [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Unrescuing
Aug 16 20:16:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:16:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:16:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'flavor' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG nova.compute.manager [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:08 user nova-compute[72894]: WARNING nova.compute.manager [req-cda7f724-ce2f-4f09-a82d-d5fda419884e req-5af2dfa1-456f-4b3b-98d0-bfa1dd568806 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:16:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:08 user nova-compute[72894]: INFO nova.compute.manager [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Terminating instance
Aug 16 20:16:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance destroyed successfully.
Aug 16 20:16:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-5575e7ad-0b32-4ac5-b366-d77c4aa01c90 req-52497463-c2e1-4343-95fe-e8337dc10a00 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Instance destroyed successfully.
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'resources' on Instance uuid e3fa3ace-3292-4957-aa6a-98f14b12795f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-267363048',display_name='tempest-TestMinimumBasicScenario-server-267363048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-267363048',id=30,image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGwnelbK3LZACinP1VRV2J6STnf5T5EHcX1sDlC8gXIqUFrn0GsKQQu3piuBb0JfgmwVp+l9mH1Q4aZ8j2rLrwoYBjnv2O3hAP+hZ/G/IplOXJwZL7ENugB+NFuBl3C6g==',key_name='tempest-TestMinimumBasicScenario-1132767044',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-wq81zxkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='09029edf-bcb8-4a49-819b-f792f8fb87bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:13:25Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=e3fa3ace-3292-4957-aa6a-98f14b12795f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "22bcca30-6f46-415c-be4a-92cb214928e8", "address": "fa:16:3e:59:d1:ae", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bcca30-6f", "ovs_interfaceid": "22bcca30-6f46-415c-be4a-92cb214928e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG os_vif [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bcca30-6f, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: INFO os_vif [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=22bcca30-6f46-415c-be4a-92cb214928e8,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bcca30-6f')
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Deleting instance files /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f_del
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Deletion of /opt/stack/data/nova/instances/e3fa3ace-3292-4957-aa6a-98f14b12795f_del complete
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.compute.manager [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 16 20:16:10 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216955.4212394, 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] VM Stopped (Lifecycle Event)
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-0c89c567-82d8-461b-999b-1c66bba4b283 None None] [instance: 4f4bb0f9-a9ca-4bde-ae50-fd20e768d355] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216955.9073677, 34d11735-e89e-4695-9ca5-d596a7b736b1 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:10 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] VM Stopped (Lifecycle Event)
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-34955310-a090-42d0-b6db-e94be0498900 None None] [instance: 34d11735-e89e-4695-9ca5-d596a7b736b1] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: WARNING nova.compute.manager [req-f8c7e429-e93b-4bd0-b0cb-409162acde2f req-7ee04a8e-7882-4bf8-8144-fce70ce6dbd2 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:11 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Took 1.14 seconds to deallocate network for instance.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: WARNING nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state deleting.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: WARNING nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state deleting.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: WARNING nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state deleting.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-unplugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Acquiring lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] No waiting events found dispatching network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:11 user nova-compute[72894]: WARNING nova.compute.manager [req-b55391c6-1f60-4201-99c7-1d03e9dc77b4 req-755cd7f2-e10f-45ac-b4f1-2b180d56d117 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received unexpected event network-vif-plugged-22bcca30-6f46-415c-be4a-92cb214928e8 for instance with vm_state active and task_state deleting.
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:16:11 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:16:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:12 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Deleted allocations for instance e3fa3ace-3292-4957-aa6a-98f14b12795f
Aug 16 20:16:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-82f38579-fc3b-4ca0-8362-9587cea78502 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "e3fa3ace-3292-4957-aa6a-98f14b12795f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.174s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7ddf92e1-2907-4e78-9959-3e1de8124120 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 6d796fab-6318-4e7b-8a75-ecc4db1db2af due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216973.201201, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:13 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Resumed (Lifecycle Event)
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:13 user nova-compute[72894]: WARNING nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Received event network-vif-deleted-22bcca30-6f46-415c-be4a-92cb214928e8 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:13 user nova-compute[72894]: WARNING nova.compute.manager [req-3b9247e6-8788-4a4d-a1c0-0fc57969ddea req-259061fa-d096-4efa-b6a2-11cfca8ff359 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:16:13 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692216973.202124, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:13 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Started (Lifecycle Event)
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:16:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing instance network info cache due to event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:16:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] Acquiring lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:16:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] Acquired lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:16:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updated VIF entry in instance network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ce3e7470-a617-4f05-b438-0f0edf85f02a req-e5474666-132a-4832-ba57-6e7fcc6d0b7d service nova] Releasing lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:17 user nova-compute[72894]: INFO nova.compute.manager [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Attaching volume 2cc2b25b-228c-48c9-9d07-4aa79aab54f8 to /dev/vdb
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.utils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231efda-a168-4757-b3ba-ec50cfe0a394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e397dc-0e2e-4473-93cd-7c8c2adef3c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[832bfa39-4462-4da1-aa39-715fe1691347]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c633158f-e2f5-443a-80c2-e37fd8b28cd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:16:17 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:16:17 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d75ca-b595-4b27-9e36-65296c17bf13]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG os_brick.utils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:16:17 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating existing volume attachment record: 2ff2119b-488f-4931-9b45-e66a19793060 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:19 user nova-compute[72894]: INFO nova.compute.manager [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Terminating instance
Aug 16 20:16:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd3f36c4-0802-42df-85bd-ae8c04a6e3f3 req-d382f8f0-acf5-4cd3-8403-3896ed1cb0e0 service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-unplugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Instance destroyed successfully.
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid 133d92d6-70ca-4d7e-90d1-4edd276e716f {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1386601857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1386601857',id=10,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-0wa2lq9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:04:18Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=133d92d6-70ca-4d7e-90d1-4edd276e716f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "721c25e7-589b-4efc-9922-305a60a69af1", "address": "fa:16:3e:24:08:74", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c25e7-58", "ovs_interfaceid": "721c25e7-589b-4efc-9922-305a60a69af1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_vif [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap721c25e7-58, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:16:20 user nova-compute[72894]: INFO os_vif [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:08:74,bridge_name='br-int',has_traffic_filtering=True,id=721c25e7-589b-4efc-9922-305a60a69af1,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c25e7-58')
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIwegxKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:16:20 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[825acc96-0e4b-4bf9-9a90-95119f7cccaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccba043-14d1-4b81-9aca-b3ffa16ea4fa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:16:20 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:20 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 (non-flash)
Aug 16 20:16:20 user nova-compute[72894]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:20 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990635360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350'): ({'sdh'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Removing single pathed devices sdh {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a1d9b-2446-411a-aece-8052743014c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a3e22-e7d6-4b39-a815-d61b700e76ea]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Flushing IO for device /dev/sdh {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56eafd-7dee-4a24-9d4a-966303646cf8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13298c-c41d-4976-ae04-6c378e1fc07a]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] SCSI volumes sdh have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5395cf7f-b816-4b14-a40b-2b239acaa1f8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ef1a0-a951-4135-a980-f7735c4f80c1]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260]
Aug 16 20:16:20 user nova-compute[72894]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350, portal: 172.16.0.220,3260] successful.
Aug 16 20:16:20 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4678fdb8-71ab-4318-bdfc-f7382f737350 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52bf4c-2fb6-4b7d-98d1-cd3e270e116d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] <== disconnect_volume: return (272ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:16:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Deleting instance files /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f_del
Aug 16 20:16:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Deletion of /opt/stack/data/nova/instances/133d92d6-70ca-4d7e-90d1-4edd276e716f_del complete
Aug 16 20:16:20 user nova-compute[72894]: INFO nova.compute.manager [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 20:16:20 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:16:20 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:20 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Took 0.51 seconds to deallocate network for instance.
Aug 16 20:16:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] Acquiring lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] No waiting events found dispatching network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:21 user nova-compute[72894]: WARNING nova.compute.manager [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received unexpected event network-vif-plugged-721c25e7-589b-4efc-9922-305a60a69af1 for instance with vm_state active and task_state deleting.
Aug 16 20:16:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-cff02072-7d0f-4198-925b-1cb014ca2a9d req-01fb3615-0cbf-4431-90b3-abcf59aa76ae service nova] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Received event network-vif-deleted-721c25e7-589b-4efc-9922-305a60a69af1 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:21 user nova-compute[72894]: INFO nova.compute.manager [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Took 0.82 seconds to detach 1 volumes for instance.
Aug 16 20:16:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:22 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:16:22 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:16:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:22 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Deleted allocations for instance 133d92d6-70ca-4d7e-90d1-4edd276e716f
Aug 16 20:16:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fea1f096-383d-42dd-9b01-c473bb3b2d14 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "133d92d6-70ca-4d7e-90d1-4edd276e716f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.221s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:25 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216970.2118342, e3fa3ace-3292-4957-aa6a-98f14b12795f => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:25 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] VM Stopped (Lifecycle Event)
Aug 16 20:16:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f854376b-8ecb-4897-b0b6-cd2111d52b82 None None] [instance: e3fa3ace-3292-4957-aa6a-98f14b12795f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgutXqRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:16:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:16:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:16:28 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a916ed56-71dc-4e18-8c1b-4bd5e3086c5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:16:28 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[185716cd-21fc-4c10-b49e-9ebf98f25b68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8] added
Aug 16 20:16:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c3c61d-ae80-438e-a172-dfc1df0352e9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4dcbdf-ad99-400e-b0e5-f21d0d5f6add]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgutXqRW {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgutXqRW" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ada0b6-8c91-4eb9-84e2-74a7315ae705]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgutXqRW'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a04568-1b36-4f36-9139-cca745cb432f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3cb1e3-a0a0-42f3-bbb7-5f40aecd11a7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:28 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:28 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd52be6-31bd-49a4-835f-275d3d221cc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260]
Aug 16 20:16:28 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260] successful.
Aug 16 20:16:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2c3f2-77bc-4949-bf98-8bbb89bcd34b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfbceed-86f3-4c1b-a0ba-6cbdfab5f7cb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:29 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:29 user nova-compute[72894]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)
Aug 16 20:16:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:29 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:29 user nova-compute[72894]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)
Aug 16 20:16:29 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[020b15a3-21f0-4653-b5ce-1446c349d6ea]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:16:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgutXqRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26333353633373061', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353633373061', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:16:30 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:16:30 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:16:30 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:16:30 user nova-compute[72894]:   <serial>2cc2b25b-228c-48c9-9d07-4aa79aab54f8</serial>
Aug 16 20:16:30 user nova-compute[72894]: </disk>
Aug 16 20:16:30 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No VIF found with MAC fa:16:3e:ca:08:45, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:16:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e346e709-03d8-43fa-90c9-957308019e92 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.814s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:33 user nova-compute[72894]: INFO nova.compute.manager [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Detaching volume 2cc2b25b-228c-48c9-9d07-4aa79aab54f8
Aug 16 20:16:33 user nova-compute[72894]: INFO nova.virt.block_device [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Attempting to driver detach volume 2cc2b25b-228c-48c9-9d07-4aa79aab54f8 from mountpoint /dev/vdb
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Attempting to detach device vdb from instance f78d339d-1c1d-44e4-94f3-d9287767ce61 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:16:33 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:16:33 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:16:33 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:16:33 user nova-compute[72894]:   <serial>2cc2b25b-228c-48c9-9d07-4aa79aab54f8</serial>
Aug 16 20:16:33 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:16:33 user nova-compute[72894]: </disk>
Aug 16 20:16:33 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:16:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully detached device vdb from instance f78d339d-1c1d-44e4-94f3-d9287767ce61 from the persistent domain config.
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f78d339d-1c1d-44e4-94f3-d9287767ce61 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:16:33 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:16:33 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:16:33 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:16:33 user nova-compute[72894]:   <serial>2cc2b25b-228c-48c9-9d07-4aa79aab54f8</serial>
Aug 16 20:16:33 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:16:33 user nova-compute[72894]: </disk>
Aug 16 20:16:33 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692216993.9862065, f78d339d-1c1d-44e4-94f3-d9287767ce61 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:16:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully detached device vdb from instance f78d339d-1c1d-44e4-94f3-d9287767ce61 from the live domain config.
Aug 16 20:16:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgutXqRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:16:33 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:16:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:16:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf29697-d47e-46e4-8cec-d7e2c78abbfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75ee21-c1ec-4f60-9ae8-0146f36a68ed]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:34 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:34 user nova-compute[72894]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)
Aug 16 20:16:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:16:34 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:16:34 user nova-compute[72894]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 (non-flash)
Aug 16 20:16:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79904976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da08459-117a-44e1-8784-19df3acac4c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23346e-8b28-4c70-ad62-60c5ee900294]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eace39-7fd1-4299-bbc2-2a768ab120cb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03976c0-b0a4-4fda-a6ac-c5e06a86f458]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067e032-58dc-46e3-9063-98b8d74ff858]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac8b5d-6ce5-4b22-b259-e48d09530f55]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260]
Aug 16 20:16:34 user nova-compute[72894]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8, portal: 172.16.0.220,3260] successful.
Aug 16 20:16:34 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc2b25b-228c-48c9-9d07-4aa79aab54f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4165939-e133-4993-9ff8-d7d68931c90b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== disconnect_volume: return (257ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:16:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-aaa59956-a26d-4b0a-83f2-cd9d4aa075cb tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.571s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:35 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692216980.0426154, 133d92d6-70ca-4d7e-90d1-4edd276e716f => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:16:35 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] VM Stopped (Lifecycle Event)
Aug 16 20:16:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ce906e43-01d6-4623-a17f-2dd66456b4df None None] [instance: 133d92d6-70ca-4d7e-90d1-4edd276e716f] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:16:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [{"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-f3d00d19-bfc7-4b98-b468-7d06526e6124" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:16:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:47 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:16:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:16:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:16:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:16:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7588MB free_disk=24.148548126220703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:51 user nova-compute[72894]: INFO nova.compute.manager [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Terminating instance
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance c4ea94f8-a824-49ae-9671-3dd1d2747423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-unplugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] No waiting events found dispatching network-vif-unplugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-3ba8289b-54d4-4bae-b04e-c79b597ba938 req-20a939ca-2b4a-47a8-81f9-b2a57827721d service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-unplugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Instance destroyed successfully.
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lazy-loading 'resources' on Instance uuid f3d00d19-bfc7-4b98-b468-7d06526e6124 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-883206817',display_name='tempest-ServerActionsTestOtherA-server-883206817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-883206817',id=3,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Q5u3e0U14ymjzcYjKVpO4XYqh7sExelErSA+pINY9xrvkS7bVb6hcRiVuDnhnhFvtR3Nl+EEiWEyVps/4fGiN3nLevvUKU4Y3Va8R651bVWAcTbakWZSXvcEHEStUeQ==',key_name='tempest-keypair-1047216430',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d388dc7ba4643d198d2999ec1f87afe',ramdisk_id='',reservation_id='r-42z2wbo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2019589976',owner_user_name='tempest-ServerActionsTestOtherA-2019589976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6787ebe74f6445caa43d44813f58ab21',uuid=f3d00d19-bfc7-4b98-b468-7d06526e6124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converting VIF {"id": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "address": "fa:16:3e:1f:49:b5", "network": {"id": "ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2089435226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d388dc7ba4643d198d2999ec1f87afe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3449faa-4f", "ovs_interfaceid": "f3449faa-4fc8-45a8-ab01-92e456d1eda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG os_vif [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3449faa-4f, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:16:51 user nova-compute[72894]: INFO os_vif [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:49:b5,bridge_name='br-int',has_traffic_filtering=True,id=f3449faa-4fc8-45a8-ab01-92e456d1eda7,network=Network(ac1cc3d1-1bcf-4e4f-ada7-0b81892c96d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3449faa-4f')
Aug 16 20:16:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Deleting instance files /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124_del
Aug 16 20:16:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Deletion of /opt/stack/data/nova/instances/f3d00d19-bfc7-4b98-b468-7d06526e6124_del complete
Aug 16 20:16:51 user nova-compute[72894]: INFO nova.compute.manager [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 16 20:16:51 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:16:51 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Took 0.50 seconds to deallocate network for instance.
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-cc7728da-9683-4a29-8ec7-50a686177d65 req-1a6116f2-3479-4891-8996-f0ba32165aa3 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-deleted-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:52 user nova-compute[72894]: INFO nova.compute.manager [req-cc7728da-9683-4a29-8ec7-50a686177d65 req-1a6116f2-3479-4891-8996-f0ba32165aa3 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Neutron deleted interface f3449faa-4fc8-45a8-ab01-92e456d1eda7; detaching it from the instance and deleting it from the info cache
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.network.neutron [req-cc7728da-9683-4a29-8ec7-50a686177d65 req-1a6116f2-3479-4891-8996-f0ba32165aa3 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-cc7728da-9683-4a29-8ec7-50a686177d65 req-1a6116f2-3479-4891-8996-f0ba32165aa3 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Detach interface failed, port_id=f3449faa-4fc8-45a8-ab01-92e456d1eda7, reason: Instance f3d00d19-bfc7-4b98-b468-7d06526e6124 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:16:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:52 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Deleted allocations for instance f3d00d19-bfc7-4b98-b468-7d06526e6124
Aug 16 20:16:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6c43a205-98b8-4062-bb14-8b415889e116 tempest-ServerActionsTestOtherA-2019589976 tempest-ServerActionsTestOtherA-2019589976-project-member] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:16:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] Acquiring lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:16:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:16:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] Lock "f3d00d19-bfc7-4b98-b468-7d06526e6124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:16:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] No waiting events found dispatching network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:16:53 user nova-compute[72894]: WARNING nova.compute.manager [req-9f08a283-5986-4b6d-b73e-0044104cf041 req-3442a752-81a3-4c5e-9d11-9723f16eb323 service nova] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Received unexpected event network-vif-plugged-f3449faa-4fc8-45a8-ab01-92e456d1eda7 for instance with vm_state deleted and task_state None.
Aug 16 20:16:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:16:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:16:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:02 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:17:02 user nova-compute[72894]: INFO nova.compute.claims [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Claim successful on node user
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:17:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.policy [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b2c321a6776409a9dea0f817f58e07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28ea40d38684e26a5abd0292d031801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:17:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Creating image(s)
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "/opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "/opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "/opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "25025f284c96ca8c365419e63fd7498675ff7817" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "25025f284c96ca8c365419e63fd7498675ff7817" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.part --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG nova.virt.images [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] 4e708b0a-3afd-43cf-b2a3-83c75e9d37d7 was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.part /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Successfully created port: 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.part /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.converted" returned: 0 in 0.156s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "25025f284c96ca8c365419e63fd7498675ff7817" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.095s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "25025f284c96ca8c365419e63fd7498675ff7817" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "25025f284c96ca8c365419e63fd7498675ff7817" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817,backing_fmt=raw /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817,backing_fmt=raw /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk 1073741824" returned: 0 in 0.052s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "25025f284c96ca8c365419e63fd7498675ff7817" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Successfully updated port: 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing instance network info cache due to event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Cannot resize image /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.objects.instance [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'migration_context' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Ensure instance console log exists: /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance network_info: |[{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:05 user nova-compute[72894]: DEBUG nova.network.neutron [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Start _get_guest_xml network_info=[{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T20:17:00Z,direct_url=<?>,disk_format='qcow2',id=4e708b0a-3afd-43cf-b2a3-83c75e9d37d7,min_disk=0,min_ram=0,name='tempest-scenario-img--2142990937',owner='d28ea40d38684e26a5abd0292d031801',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T20:17:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '4e708b0a-3afd-43cf-b2a3-83c75e9d37d7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:17:06 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:06 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T20:17:00Z,direct_url=<?>,disk_format='qcow2',id=4e708b0a-3afd-43cf-b2a3-83c75e9d37d7,min_disk=0,min_ram=0,name='tempest-scenario-img--2142990937',owner='d28ea40d38684e26a5abd0292d031801',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T20:17:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1712131699',display_name='tempest-TestMinimumBasicScenario-server-1712131699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1712131699',id=37,image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUjYbTstpwZ5GEM+zUbxVUJCqd+EL/f2YxiUzHLXa5frYKGrvoKABIU7p04bTH0Veqa7dZfvHVodhzN3GGUWiiTDmxbvKFuYFNFHrd23tT33h4/pUFJjXatHIwlR+HwOA==',key_name='tempest-TestMinimumBasicScenario-2103614112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-qlgzqjdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:03Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=997cca71-e41a-455e-a02b-854d7fad614b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'pci_devices' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:17:06 user nova-compute[72894]:   <uuid>997cca71-e41a-455e-a02b-854d7fad614b</uuid>
Aug 16 20:17:06 user nova-compute[72894]:   <name>instance-00000025</name>
Aug 16 20:17:06 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:17:06 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:17:06 user nova-compute[72894]:   <metadata>
Aug 16 20:17:06 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:17:06 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:name>tempest-TestMinimumBasicScenario-server-1712131699</nova:name>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:17:06</nova:creationTime>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:17:06 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:17:06 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:owner>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:user uuid="1b2c321a6776409a9dea0f817f58e07a">tempest-TestMinimumBasicScenario-872391646-project-member</nova:user>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:project uuid="d28ea40d38684e26a5abd0292d031801">tempest-TestMinimumBasicScenario-872391646</nova:project>
Aug 16 20:17:06 user nova-compute[72894]:       </nova:owner>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:root type="image" uuid="4e708b0a-3afd-43cf-b2a3-83c75e9d37d7"/>
Aug 16 20:17:06 user nova-compute[72894]:       <nova:ports>
Aug 16 20:17:06 user nova-compute[72894]:         <nova:port uuid="07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb">
Aug 16 20:17:06 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 20:17:06 user nova-compute[72894]:         </nova:port>
Aug 16 20:17:06 user nova-compute[72894]:       </nova:ports>
Aug 16 20:17:06 user nova-compute[72894]:     </nova:instance>
Aug 16 20:17:06 user nova-compute[72894]:   </metadata>
Aug 16 20:17:06 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:17:06 user nova-compute[72894]:     <system>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="serial">997cca71-e41a-455e-a02b-854d7fad614b</entry>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="uuid">997cca71-e41a-455e-a02b-854d7fad614b</entry>
Aug 16 20:17:06 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:17:06 user nova-compute[72894]:     </system>
Aug 16 20:17:06 user nova-compute[72894]:   </sysinfo>
Aug 16 20:17:06 user nova-compute[72894]:   <os>
Aug 16 20:17:06 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:17:06 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:17:06 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:17:06 user nova-compute[72894]:   </os>
Aug 16 20:17:06 user nova-compute[72894]:   <features>
Aug 16 20:17:06 user nova-compute[72894]:     <acpi/>
Aug 16 20:17:06 user nova-compute[72894]:     <apic/>
Aug 16 20:17:06 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:17:06 user nova-compute[72894]:   </features>
Aug 16 20:17:06 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:17:06 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:17:06 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:17:06 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:17:06 user nova-compute[72894]:   </clock>
Aug 16 20:17:06 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:17:06 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:17:06 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:17:06 user nova-compute[72894]:   </cpu>
Aug 16 20:17:06 user nova-compute[72894]:   <devices>
Aug 16 20:17:06 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:17:06 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:17:06 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk"/>
Aug 16 20:17:06 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:17:06 user nova-compute[72894]:     </disk>
Aug 16 20:17:06 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:17:06 user nova-compute[72894]:       <mac address="fa:16:3e:e3:e7:c5"/>
Aug 16 20:17:06 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:06 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:17:06 user nova-compute[72894]:       <target dev="tap07cfa1ee-e8"/>
Aug 16 20:17:06 user nova-compute[72894]:     </interface>
Aug 16 20:17:06 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:17:06 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/console.log" append="off"/>
Aug 16 20:17:06 user nova-compute[72894]:     </serial>
Aug 16 20:17:06 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:17:06 user nova-compute[72894]:     <video>
Aug 16 20:17:06 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:06 user nova-compute[72894]:     </video>
Aug 16 20:17:06 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:17:06 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:17:06 user nova-compute[72894]:     </rng>
Aug 16 20:17:06 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:17:06 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:17:06 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:17:06 user nova-compute[72894]:     </memballoon>
Aug 16 20:17:06 user nova-compute[72894]:   </devices>
Aug 16 20:17:06 user nova-compute[72894]: </domain>
Aug 16 20:17:06 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1712131699',display_name='tempest-TestMinimumBasicScenario-server-1712131699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1712131699',id=37,image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUjYbTstpwZ5GEM+zUbxVUJCqd+EL/f2YxiUzHLXa5frYKGrvoKABIU7p04bTH0Veqa7dZfvHVodhzN3GGUWiiTDmxbvKFuYFNFHrd23tT33h4/pUFJjXatHIwlR+HwOA==',key_name='tempest-TestMinimumBasicScenario-2103614112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-qlgzqjdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:03Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=997cca71-e41a-455e-a02b-854d7fad614b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG os_vif [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07cfa1ee-e8, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07cfa1ee-e8, col_values=(('external_ids', {'iface-id': '07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e7:c5', 'vm-uuid': '997cca71-e41a-455e-a02b-854d7fad614b'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:06 user nova-compute[72894]: INFO os_vif [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8')
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No VIF found with MAC fa:16:3e:e3:e7:c5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated VIF entry in instance network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-44ce03fb-2a52-4e53-8c1d-d1ab054de20c req-f21c3663-18fe-43a9-98dd-7004a1a63772 service nova] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217011.8327188, f3d00d19-bfc7-4b98-b468-7d06526e6124 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:06 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] VM Stopped (Lifecycle Event)
Aug 16 20:17:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-df0ffe80-4a06-4bde-9b5b-2d4d11b2bb35 None None] [instance: f3d00d19-bfc7-4b98-b468-7d06526e6124] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:07 user nova-compute[72894]: WARNING nova.compute.manager [req-d2f65403-88a1-4258-8562-170465903105 req-195a8b3a-a8ce-47c4-ab4d-76951a5eec48 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state building and task_state spawning.
Aug 16 20:17:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing instance network info cache due to event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] Acquiring lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] Acquired lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217029.7190957, 997cca71-e41a-455e-a02b-854d7fad614b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:09 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] VM Resumed (Lifecycle Event)
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:17:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance spawned successfully.
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updated VIF entry in instance network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:09 user nova-compute[72894]: WARNING nova.compute.manager [req-8733cb94-0d69-48df-a39f-d5b8ecd5524b req-108b9d45-e657-424d-98dd-a75178a457a8 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state building and task_state spawning.
Aug 16 20:17:09 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217029.720416, 997cca71-e41a-455e-a02b-854d7fad614b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:09 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] VM Started (Lifecycle Event)
Aug 16 20:17:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-46bd636e-9512-44fb-bdf0-174cda3e6520 req-f84de0b3-8ef2-4a89-8d3d-80f51e9376cd service nova] Releasing lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:10 user nova-compute[72894]: INFO nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 16 20:17:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:10 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:17:10 user nova-compute[72894]: INFO nova.compute.manager [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Took 7.35 seconds to build instance.
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-dcc7c950-e28b-4137-92bc-bed6d1c307d4 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.450s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:10 user nova-compute[72894]: INFO nova.compute.manager [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Terminating instance
Aug 16 20:17:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:11 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Instance destroyed successfully.
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lazy-loading 'resources' on Instance uuid 5ac6a4fb-e267-4273-930d-54f6b20e1d03 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063472027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063472027',id=1,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0853a75dd30c499288bb5e848f038580',ramdisk_id='',reservation_id='r-79ivzmle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:59:26Z,user_data=None,user_id='5c9bdeca6ea84622835b26c7565f148c',uuid=5ac6a4fb-e267-4273-930d-54f6b20e1d03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converting VIF {"id": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "address": "fa:16:3e:c3:bc:5e", "network": {"id": "c9916154-c987-4a08-9a17-73e7e1e59c96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1834783157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0853a75dd30c499288bb5e848f038580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e1238f-ce", "ovs_interfaceid": "a0e1238f-ce15-4409-a4da-940ad77f4f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG os_vif [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e1238f-ce, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:11 user nova-compute[72894]: INFO os_vif [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:5e,bridge_name='br-int',has_traffic_filtering=True,id=a0e1238f-ce15-4409-a4da-940ad77f4f75,network=Network(c9916154-c987-4a08-9a17-73e7e1e59c96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e1238f-ce')
Aug 16 20:17:11 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Deleting instance files /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03_del
Aug 16 20:17:11 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Deletion of /opt/stack/data/nova/instances/5ac6a4fb-e267-4273-930d-54f6b20e1d03_del complete
Aug 16 20:17:11 user nova-compute[72894]: INFO nova.compute.manager [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-unplugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] No waiting events found dispatching network-vif-unplugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-unplugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Acquiring lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:11 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] No waiting events found dispatching network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:11 user nova-compute[72894]: WARNING nova.compute.manager [req-0c92edc4-a93a-451e-b67a-acf336b75ef8 req-76dc6fa3-0e2b-4388-8b82-1bb3179495a1 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received unexpected event network-vif-plugged-a0e1238f-ce15-4409-a4da-940ad77f4f75 for instance with vm_state active and task_state deleting.
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:12 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Took 0.50 seconds to deallocate network for instance.
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe15d382-6480-4a1f-bf67-566f1a46f8ba req-28bf5276-e931-4f78-a979-96e991ff0fa4 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Received event network-vif-deleted-a0e1238f-ce15-4409-a4da-940ad77f4f75 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:12 user nova-compute[72894]: INFO nova.compute.manager [req-fe15d382-6480-4a1f-bf67-566f1a46f8ba req-28bf5276-e931-4f78-a979-96e991ff0fa4 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Neutron deleted interface a0e1238f-ce15-4409-a4da-940ad77f4f75; detaching it from the instance and deleting it from the info cache
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-fe15d382-6480-4a1f-bf67-566f1a46f8ba req-28bf5276-e931-4f78-a979-96e991ff0fa4 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-fe15d382-6480-4a1f-bf67-566f1a46f8ba req-28bf5276-e931-4f78-a979-96e991ff0fa4 service nova] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Detach interface failed, port_id=a0e1238f-ce15-4409-a4da-940ad77f4f75, reason: Instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:17:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:12 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Deleted allocations for instance 5ac6a4fb-e267-4273-930d-54f6b20e1d03
Aug 16 20:17:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d8a7bd02-8b53-42d6-b2ea-8b2a30a7a8b0 tempest-ServerBootFromVolumeStableRescueTest-1302332523 tempest-ServerBootFromVolumeStableRescueTest-1302332523-project-member] Lock "5ac6a4fb-e267-4273-930d-54f6b20e1d03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:17:23 user nova-compute[72894]: INFO nova.compute.claims [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Claim successful on node user
Aug 16 20:17:23 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:17:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:17:24 user nova-compute[72894]: INFO nova.virt.block_device [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Booting with volume 703d0f0f-3659-4837-8177-9f7f7d7ed61e at /dev/vda
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.policy [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b7460311d94421a6015c08fa900e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0dcce533e44566820c42e5d984ce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.utils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[46425f10-faa3-4cff-9119-c5676ae7ff01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7465d-720f-4b33-934b-2767d871667c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277a2e7-bc2f-4530-8dcb-b245b8aecb78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c135ca6-0bcf-45fe-af27-aed72d6e8c97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:17:24 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:17:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c46c7-323e-4b73-b4be-d43bff064991]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG os_brick.utils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating existing volume attachment record: 3547baeb-c17d-4901-a266-cda97e2a3b5c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:17:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Successfully created port: a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Successfully updated port: a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquired lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing instance network info cache due to event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] Acquiring lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating instance_info_cache with network_info: [{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Releasing lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Instance network_info: |[{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] Acquired lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217031.4558074, 5ac6a4fb-e267-4273-930d-54f6b20e1d03 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:26 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] VM Stopped (Lifecycle Event)
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-57ebde5b-322f-4d59-92f9-3b3a73208a42 None None] [instance: 5ac6a4fb-e267-4273-930d-54f6b20e1d03] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updated VIF entry in instance network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG nova.network.neutron [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating instance_info_cache with network_info: [{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d51b7d0b-82c7-41e0-8c4f-484d12138617 req-380d1129-3be9-47d0-908c-b2aa8e6128f4 service nova] Releasing lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:33 user nova-compute[72894]: INFO nova.compute.manager [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] instance snapshotting
Aug 16 20:17:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Beginning live snapshot process
Aug 16 20:17:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c.delta 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c.delta 1073741824" returned: 0 in 0.070s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 20:17:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:17:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:17:35 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 20:17:35 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:17:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c.delta /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c.delta /opt/stack/data/nova/instances/snapshots/tmpnv2cwoil/1e4195e835634430b3d1eddf4d68342c" returned: 0 in 0.278s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:35 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Snapshot extracted, beginning image upload
Aug 16 20:17:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Snapshot image upload complete
Aug 16 20:17:38 user nova-compute[72894]: INFO nova.compute.manager [None req-0668ddda-9b09-4827-b92d-91e00cd5c46c tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Took 4.89 seconds to snapshot the instance on the hypervisor.
Aug 16 20:17:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:17:40 user nova-compute[72894]: INFO nova.compute.claims [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Claim successful on node user
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:17:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.policy [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ec5f4494fff47b2aef65898afa8afa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb802770440441ca765afcbca83440e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:17:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Creating image(s)
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "/opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "/opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "/opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Successfully created port: 0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:17:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.part --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.images [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] 7f929eb8-b442-46f5-8669-45536dded29a was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.part /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.part /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.converted" returned: 0 in 0.301s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.751s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:17:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Creating image(s)
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Ensure instance console log exists: /opt/stack/data/nova/instances/4a4d6375-4096-455f-8c72-6fc8197c16f0/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Start _get_guest_xml network_info=[{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '3547baeb-c17d-4901-a266-cda97e2a3b5c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdEGIlzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a4d6375-4096-455f-8c72-6fc8197c16f0', 'attached_at': '', 'detached_at': '', 'volume_id': '703d0f0f-3659-4837-8177-9f7f7d7ed61e', 'serial': '703d0f0f-3659-4837-8177-9f7f7d7ed61e'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:17:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdEGIlzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:17:42 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:17:42 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:17:42 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5e64f-31d2-4793-9c7d-bf1864361f74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:17:42 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae1494-d2fe-4d29-a5b1-22edd044bd32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e] added
Aug 16 20:17:42 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b5270-0883-4092-93e9-0b4d5922846f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d4c46a-188b-40a9-afb8-e43f8887f0d3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdEGIlzD {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdEGIlzD" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29806251-e2af-491d-92c1-9e937fba0f6b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdEGIlzD'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c552a2fc-a466-4a0b-9907-cda8db79780c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[651ecf26-477b-4b54-bd2d-b64800e0ea47]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e,backing_fmt=raw /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e,backing_fmt=raw /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk 1073741824" returned: 0 in 0.064s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "64ef4fdf63e63585bafa3da569d24a446a33c90e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7a839b-acb4-4e3a-a8cf-1599853a593a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260]
Aug 16 20:17:43 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260] successful.
Aug 16 20:17:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001675b-5498-47d0-aae6-5daaf9fc10b6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc8bafb-2b4f-46c1-847e-923a7b9ee9d9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:43 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Successfully updated port: 0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a294b-ba06-45d1-9b73-66b0aadc43d9]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdEGIlzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquired lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.compute.manager [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing instance network info cache due to event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] Acquiring lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e --force-share --output=json" returned: 0 in 0.210s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'migration_context' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Ensure instance console log exists: /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating instance_info_cache with network_info: [{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Releasing lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Instance network_info: |[{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] Acquired lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.neutron [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Start _get_guest_xml network_info=[{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c70d7bb9af26a647dbf5c98de8b6cfea',container_format='bare',created_at=2023-08-16T20:17:33Z,direct_url=<?>,disk_format='qcow2',id=7f929eb8-b442-46f5-8669-45536dded29a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-164757883',owner='5bb802770440441ca765afcbca83440e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T20:17:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7f929eb8-b442-46f5-8669-45536dded29a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:17:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c70d7bb9af26a647dbf5c98de8b6cfea',container_format='bare',created_at=2023-08-16T20:17:33Z,direct_url=<?>,disk_format='qcow2',id=7f929eb8-b442-46f5-8669-45536dded29a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-164757883',owner='5bb802770440441ca765afcbca83440e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T20:17:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1303090262',display_name='tempest-TestStampPattern-server-1303090262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1303090262',id=39,image_ref='7f929eb8-b442-46f5-8669-45536dded29a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-d7d6akhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f78d339d-1c1d-44e4-94f3-d9287767ce61',image_min_disk='1',image_min_ram='0',image_owner_id='5bb802770440441ca765afcbca83440e',image_owner_project_name='tempest-TestStampPattern-1667960248',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1667960248-project-member',image_user_id='5ec5f4494fff47b2aef65898afa8afa0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:41Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=1421be15-19af-4c18-989f-dd13aa3042e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'pci_devices' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:17:43 user nova-compute[72894]:   <uuid>1421be15-19af-4c18-989f-dd13aa3042e7</uuid>
Aug 16 20:17:43 user nova-compute[72894]:   <name>instance-00000027</name>
Aug 16 20:17:43 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:17:43 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:17:43 user nova-compute[72894]:   <metadata>
Aug 16 20:17:43 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:17:43 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:name>tempest-TestStampPattern-server-1303090262</nova:name>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:17:43</nova:creationTime>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:17:43 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:17:43 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:owner>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:user uuid="5ec5f4494fff47b2aef65898afa8afa0">tempest-TestStampPattern-1667960248-project-member</nova:user>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:project uuid="5bb802770440441ca765afcbca83440e">tempest-TestStampPattern-1667960248</nova:project>
Aug 16 20:17:43 user nova-compute[72894]:       </nova:owner>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:root type="image" uuid="7f929eb8-b442-46f5-8669-45536dded29a"/>
Aug 16 20:17:43 user nova-compute[72894]:       <nova:ports>
Aug 16 20:17:43 user nova-compute[72894]:         <nova:port uuid="0ee585fc-2800-4171-a8f4-de40cb744eb5">
Aug 16 20:17:43 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:17:43 user nova-compute[72894]:         </nova:port>
Aug 16 20:17:43 user nova-compute[72894]:       </nova:ports>
Aug 16 20:17:43 user nova-compute[72894]:     </nova:instance>
Aug 16 20:17:43 user nova-compute[72894]:   </metadata>
Aug 16 20:17:43 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:17:43 user nova-compute[72894]:     <system>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="serial">1421be15-19af-4c18-989f-dd13aa3042e7</entry>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="uuid">1421be15-19af-4c18-989f-dd13aa3042e7</entry>
Aug 16 20:17:43 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:17:43 user nova-compute[72894]:     </system>
Aug 16 20:17:43 user nova-compute[72894]:   </sysinfo>
Aug 16 20:17:43 user nova-compute[72894]:   <os>
Aug 16 20:17:43 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:17:43 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:17:43 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:17:43 user nova-compute[72894]:   </os>
Aug 16 20:17:43 user nova-compute[72894]:   <features>
Aug 16 20:17:43 user nova-compute[72894]:     <acpi/>
Aug 16 20:17:43 user nova-compute[72894]:     <apic/>
Aug 16 20:17:43 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:17:43 user nova-compute[72894]:   </features>
Aug 16 20:17:43 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:17:43 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:17:43 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:17:43 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:17:43 user nova-compute[72894]:   </clock>
Aug 16 20:17:43 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:17:43 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:17:43 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:17:43 user nova-compute[72894]:   </cpu>
Aug 16 20:17:43 user nova-compute[72894]:   <devices>
Aug 16 20:17:43 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:17:43 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:17:43 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk"/>
Aug 16 20:17:43 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:17:43 user nova-compute[72894]:     </disk>
Aug 16 20:17:43 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:17:43 user nova-compute[72894]:       <mac address="fa:16:3e:e8:5a:d5"/>
Aug 16 20:17:43 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:43 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:17:43 user nova-compute[72894]:       <target dev="tap0ee585fc-28"/>
Aug 16 20:17:43 user nova-compute[72894]:     </interface>
Aug 16 20:17:43 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:17:43 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/console.log" append="off"/>
Aug 16 20:17:43 user nova-compute[72894]:     </serial>
Aug 16 20:17:43 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:17:43 user nova-compute[72894]:     <video>
Aug 16 20:17:43 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:43 user nova-compute[72894]:     </video>
Aug 16 20:17:43 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:17:43 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:17:43 user nova-compute[72894]:     </rng>
Aug 16 20:17:43 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:17:43 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:17:43 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:17:43 user nova-compute[72894]:     </memballoon>
Aug 16 20:17:43 user nova-compute[72894]:   </devices>
Aug 16 20:17:43 user nova-compute[72894]: </domain>
Aug 16 20:17:43 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1303090262',display_name='tempest-TestStampPattern-server-1303090262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1303090262',id=39,image_ref='7f929eb8-b442-46f5-8669-45536dded29a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-d7d6akhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f78d339d-1c1d-44e4-94f3-d9287767ce61',image_min_disk='1',image_min_ram='0',image_owner_id='5bb802770440441ca765afcbca83440e',image_owner_project_name='tempest-TestStampPattern-1667960248',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1667960248-project-member',image_user_id='5ec5f4494fff47b2aef65898afa8afa0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:41Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=1421be15-19af-4c18-989f-dd13aa3042e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG os_vif [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee585fc-28, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ee585fc-28, col_values=(('external_ids', {'iface-id': '0ee585fc-2800-4171-a8f4-de40cb744eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:5a:d5', 'vm-uuid': '1421be15-19af-4c18-989f-dd13aa3042e7'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:43 user nova-compute[72894]: INFO os_vif [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28')
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:17:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No VIF found with MAC fa:16:3e:e8:5a:d5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.neutron [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updated VIF entry in instance network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.neutron [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating instance_info_cache with network_info: [{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c875b886-11d9-4a5d-993c-b094e31d7375 req-823dc84c-d893-4d4e-82eb-6783fb635e03 service nova] Releasing lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23538393437303564', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538393437303564', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-154719082',display_name='tempest-TestVolumeBootPattern-server-154719082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-154719082',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-f0jsjj0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:24Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=4a4d6375-4096-455f-8c72-6fc8197c16f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a4d6375-4096-455f-8c72-6fc8197c16f0 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:17:44 user nova-compute[72894]:   <uuid>4a4d6375-4096-455f-8c72-6fc8197c16f0</uuid>
Aug 16 20:17:44 user nova-compute[72894]:   <name>instance-00000026</name>
Aug 16 20:17:44 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:17:44 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:17:44 user nova-compute[72894]:   <metadata>
Aug 16 20:17:44 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:17:44 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:17:44 user nova-compute[72894]:       <nova:name>tempest-TestVolumeBootPattern-server-154719082</nova:name>
Aug 16 20:17:44 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:17:42</nova:creationTime>
Aug 16 20:17:44 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:17:44 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:17:44 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:17:44 user nova-compute[72894]:       <nova:owner>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:user uuid="e4b7460311d94421a6015c08fa900e6c">tempest-TestVolumeBootPattern-1700099963-project-member</nova:user>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:project uuid="2b0dcce533e44566820c42e5d984ce38">tempest-TestVolumeBootPattern-1700099963</nova:project>
Aug 16 20:17:44 user nova-compute[72894]:       </nova:owner>
Aug 16 20:17:44 user nova-compute[72894]:       <nova:ports>
Aug 16 20:17:44 user nova-compute[72894]:         <nova:port uuid="a9a1a861-90dd-402d-bd8a-48d95ff19b7c">
Aug 16 20:17:44 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 20:17:44 user nova-compute[72894]:         </nova:port>
Aug 16 20:17:44 user nova-compute[72894]:       </nova:ports>
Aug 16 20:17:44 user nova-compute[72894]:     </nova:instance>
Aug 16 20:17:44 user nova-compute[72894]:   </metadata>
Aug 16 20:17:44 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:17:44 user nova-compute[72894]:     <system>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="serial">4a4d6375-4096-455f-8c72-6fc8197c16f0</entry>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="uuid">4a4d6375-4096-455f-8c72-6fc8197c16f0</entry>
Aug 16 20:17:44 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:17:44 user nova-compute[72894]:     </system>
Aug 16 20:17:44 user nova-compute[72894]:   </sysinfo>
Aug 16 20:17:44 user nova-compute[72894]:   <os>
Aug 16 20:17:44 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:17:44 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:17:44 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:17:44 user nova-compute[72894]:   </os>
Aug 16 20:17:44 user nova-compute[72894]:   <features>
Aug 16 20:17:44 user nova-compute[72894]:     <acpi/>
Aug 16 20:17:44 user nova-compute[72894]:     <apic/>
Aug 16 20:17:44 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:17:44 user nova-compute[72894]:   </features>
Aug 16 20:17:44 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:17:44 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:17:44 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:17:44 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:17:44 user nova-compute[72894]:   </clock>
Aug 16 20:17:44 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:17:44 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:17:44 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:17:44 user nova-compute[72894]:   </cpu>
Aug 16 20:17:44 user nova-compute[72894]:   <devices>
Aug 16 20:17:44 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:17:44 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:17:44 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:17:44 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:17:44 user nova-compute[72894]:       <serial>703d0f0f-3659-4837-8177-9f7f7d7ed61e</serial>
Aug 16 20:17:44 user nova-compute[72894]:     </disk>
Aug 16 20:17:44 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:17:44 user nova-compute[72894]:       <mac address="fa:16:3e:52:e4:ba"/>
Aug 16 20:17:44 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:44 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:17:44 user nova-compute[72894]:       <target dev="tapa9a1a861-90"/>
Aug 16 20:17:44 user nova-compute[72894]:     </interface>
Aug 16 20:17:44 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:17:44 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4a4d6375-4096-455f-8c72-6fc8197c16f0/console.log" append="off"/>
Aug 16 20:17:44 user nova-compute[72894]:     </serial>
Aug 16 20:17:44 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:17:44 user nova-compute[72894]:     <video>
Aug 16 20:17:44 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:17:44 user nova-compute[72894]:     </video>
Aug 16 20:17:44 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:17:44 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:17:44 user nova-compute[72894]:     </rng>
Aug 16 20:17:44 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:17:44 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:17:44 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:17:44 user nova-compute[72894]:     </memballoon>
Aug 16 20:17:44 user nova-compute[72894]:   </devices>
Aug 16 20:17:44 user nova-compute[72894]: </domain>
Aug 16 20:17:44 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-154719082',display_name='tempest-TestVolumeBootPattern-server-154719082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-154719082',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-f0jsjj0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:17:24Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=4a4d6375-4096-455f-8c72-6fc8197c16f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG os_vif [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9a1a861-90, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9a1a861-90, col_values=(('external_ids', {'iface-id': 'a9a1a861-90dd-402d-bd8a-48d95ff19b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:e4:ba', 'vm-uuid': '4a4d6375-4096-455f-8c72-6fc8197c16f0'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:44 user nova-compute[72894]: INFO os_vif [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90')
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:17:44 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] No VIF found with MAC fa:16:3e:52:e4:ba, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG nova.objects.instance [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lazy-loading 'flavor' on Instance uuid c4ea94f8-a824-49ae-9671-3dd1d2747423 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:45 user nova-compute[72894]: INFO nova.compute.manager [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Attaching volume 75daec95-d394-45eb-bb07-92ed888c2100 to /dev/vdb
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.utils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b33719-6243-46ac-a595-3f66df682d9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[41472f7e-7a4f-4a83-b444-058ba1310905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[27844165-ff21-464c-a2c2-b1f88b574482]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340a861-7443-4477-92c3-28f17648fd72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:17:45 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:17:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f20f5-f800-4277-b6be-6edfcfe2c00b]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG os_brick.utils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:17:45 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Updating existing volume attachment record: 15937a0a-c2bd-4b8d-a76c-1c91b38fa93c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [{"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-60dd6c6f-825a-4367-a215-c3989d1db134" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] No waiting events found dispatching network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:46 user nova-compute[72894]: WARNING nova.compute.manager [req-109d7c1e-5886-4fc3-9cf9-fdc805eac6e0 req-8988986d-dc04-433b-bec9-308aa0329ffb service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received unexpected event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 for instance with vm_state building and task_state spawning.
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] No waiting events found dispatching network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:46 user nova-compute[72894]: WARNING nova.compute.manager [req-b119b6d4-9493-4720-b37a-740df829e84b req-ad8afa5f-f8fc-40f9-bc4e-cefbec53a86c service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received unexpected event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c for instance with vm_state building and task_state spawning.
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:47 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] No waiting events found dispatching network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:48 user nova-compute[72894]: WARNING nova.compute.manager [req-5f29a780-2ec3-419d-a37b-0fab7fe4193f req-49cca145-4d4a-4b0f-b2eb-e1030448e9ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received unexpected event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 for instance with vm_state building and task_state spawning.
Aug 16 20:17:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] No waiting events found dispatching network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:17:48 user nova-compute[72894]: WARNING nova.compute.manager [req-148efed9-08b2-4153-88a5-5ead0faadac8 req-b0152afc-942d-47a0-9636-ec2d1b0eb8c2 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received unexpected event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c for instance with vm_state building and task_state spawning.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217069.3444467, 4a4d6375-4096-455f-8c72-6fc8197c16f0 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] VM Resumed (Lifecycle Event)
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Instance spawned successfully.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Instance spawned successfully.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217069.347889, 4a4d6375-4096-455f-8c72-6fc8197c16f0 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] VM Started (Lifecycle Event)
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217069.3512952, 1421be15-19af-4c18-989f-dd13aa3042e7 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] VM Resumed (Lifecycle Event)
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Took 8.61 seconds to spawn the instance on the hypervisor.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Took 6.83 seconds to spawn the instance on the hypervisor.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217069.3513885, 1421be15-19af-4c18-989f-dd13aa3042e7 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] VM Started (Lifecycle Event)
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Took 9.40 seconds to build instance.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e390906f-edb0-410d-ba67-7386a55892ef tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.564s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:49 user nova-compute[72894]: INFO nova.compute.manager [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Took 26.25 seconds to build instance.
Aug 16 20:17:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4c96c8fa-a5d0-47d5-ac62-5a10f8adb37d tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.370s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=24.096622467041016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance c4ea94f8-a824-49ae-9671-3dd1d2747423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 997cca71-e41a-455e-a02b-854d7fad614b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4a4d6375-4096-455f-8c72-6fc8197c16f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1421be15-19af-4c18-989f-dd13aa3042e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:17:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:17:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:17:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:17:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:17:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:17:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKMuObJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:17:58 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:17:58 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:17:58 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f36d7e-653d-4cb4-957c-20cabb64db23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:17:58 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73900a5-66db-4a09-b5fe-d74b3e3bb3b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100] added
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[47685829-1987-46b4-ae0d-8a1a768814af]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bda99a-d282-4eff-ab17-cc79098d8076]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKMuObJt {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKMuObJt" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a84d91-8f63-4f46-af48-25dd04b95541]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aKMuObJt'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5ac52-fa11-4dab-81d4-83fad24b3a82]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16693fa-9a0d-497e-94ce-18de31d39cbc]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[994196bc-a670-4f5c-85d6-af6b4c8edaf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260]
Aug 16 20:17:58 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260] successful.
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7aeb5b-1809-4e63-86f8-fb0526c97f19]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc307c-006d-40c2-bc69-e82e4ee72654]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:17:58 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:17:58 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afb6f67-c7fb-466c-a68e-6997d62cd775]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:17:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKMuObJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing instance network info cache due to event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23063343037373434', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063343037373434', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lazy-loading 'flavor' on Instance uuid c4ea94f8-a824-49ae-9671-3dd1d2747423 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:17:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:17:59 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:17:59 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:17:59 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:17:59 user nova-compute[72894]:   <serial>75daec95-d394-45eb-bb07-92ed888c2100</serial>
Aug 16 20:17:59 user nova-compute[72894]: </disk>
Aug 16 20:17:59 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:00 user nova-compute[72894]: INFO nova.compute.manager [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Detaching volume 8aacb8c8-4eef-4b3b-8f19-a817160225e2
Aug 16 20:18:00 user nova-compute[72894]: INFO nova.virt.block_device [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Attempting to driver detach volume 8aacb8c8-4eef-4b3b-8f19-a817160225e2 from mountpoint /dev/vdb
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Attempting to detach device vdb from instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:18:00 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:18:00 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:18:00 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:18:00 user nova-compute[72894]:   <serial>8aacb8c8-4eef-4b3b-8f19-a817160225e2</serial>
Aug 16 20:18:00 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:18:00 user nova-compute[72894]: </disk>
Aug 16 20:18:00 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:18:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully detached device vdb from instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af from the persistent domain config.
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:18:00 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:18:00 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:18:00 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:18:00 user nova-compute[72894]:   <serial>8aacb8c8-4eef-4b3b-8f19-a817160225e2</serial>
Aug 16 20:18:00 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:18:00 user nova-compute[72894]: </disk>
Aug 16 20:18:00 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] No VIF found with MAC fa:16:3e:61:6b:53, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updated VIF entry in instance network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8ba05f9d-17de-4c5f-ace6-882da91e92aa req-ce3af377-39d6-4a74-acfc-4b9069a291b5 service nova] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-032eb3ca-ef9e-4dc0-8bbc-7bb27e7eeabe tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.060s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217080.8456712, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:18:00 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully detached device vdb from instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af from the live domain config.
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZMuOcTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:18:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd27e24-6c71-4943-968d-43f4a3d57557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:00 user nova-compute[72894]: INFO nova.compute.manager [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Terminating instance
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c215d47-cffd-4de2-a3a8-7182c5cc3900]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:18:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:18:00 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:18:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799066eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5a9a4-836d-4b3d-b07f-fa25bdb867a6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[116956f2-865f-4923-aa13-62a6aaa16b03]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae642b1-b869-484d-b046-6b73a22bad47]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6b3f5-7651-458a-a089-499a9314fa6c]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f2ddb2-68dc-40aa-b418-e740c5e6c9d1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a47d53-dfc3-48e5-a900-f0d32c534893]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260]
Aug 16 20:18:01 user nova-compute[72894]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2, portal: 172.16.0.220,3260] successful.
Aug 16 20:18:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aacb8c8-4eef-4b3b-8f19-a817160225e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805ba44-b6a8-440d-9b9d-c60e62d43788]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] <== disconnect_volume: return (450ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-unplugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] No waiting events found dispatching network-vif-unplugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-57c0e575-8f2b-4c1d-8069-6604aec4884f req-9d89c89b-afbe-4efe-972e-8f09349e92f5 service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-unplugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing instance network info cache due to event network-changed-8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] Acquiring lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] Acquired lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.network.neutron [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Refreshing network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:18:01 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Instance destroyed successfully.
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lazy-loading 'resources' on Instance uuid c4ea94f8-a824-49ae-9671-3dd1d2747423 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1814657161',display_name='tempest-DeleteServersTestJSON-server-1814657161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1814657161',id=36,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aae53333457144c0930deb3f59ae9ad1',ramdisk_id='',reservation_id='r-di9a9vzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-238489581',owner_user_name='tempest-DeleteServersTestJSON-238489581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:15:58Z,user_data=None,user_id='30c3a1069dde434c8a1e9493e2c493d2',uuid=c4ea94f8-a824-49ae-9671-3dd1d2747423,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converting VIF {"id": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "address": "fa:16:3e:61:6b:53", "network": {"id": "d9f1e14e-fc2e-4595-ae97-a717096a8e35", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-186271713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aae53333457144c0930deb3f59ae9ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4ba607-9a", "ovs_interfaceid": "1f4ba607-9a2d-4458-bd7d-2833a6f3480a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_vif [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4ba607-9a, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:18:01 user nova-compute[72894]: INFO os_vif [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6b:53,bridge_name='br-int',has_traffic_filtering=True,id=1f4ba607-9a2d-4458-bd7d-2833a6f3480a,network=Network(d9f1e14e-fc2e-4595-ae97-a717096a8e35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4ba607-9a')
Aug 16 20:18:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKMuObJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:18:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa5615-bec5-41d1-914f-c7ffcc052e24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378fa09-268d-461e-862d-ddb581175c88]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:18:01 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:18:01 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:18:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:18:01 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:18:01 user nova-compute[72894]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 (non-flash)
Aug 16 20:18:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990128160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:18:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a11f5-1b04-49db-b7d5-a54d00393fb0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af7196a-37b2-4646-a0f9-d563ec8edbde]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[17397ea0-62ef-4885-a8b6-d5e513250124]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bd2b8a-087c-4e1a-969e-909099c5f9e5]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e99ccd-fb5d-46bc-aacf-4aea545df4d3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a3acf-e574-4e7d-ba36-8ea7f17badf8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260]
Aug 16 20:18:02 user nova-compute[72894]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100, portal: 172.16.0.220,3260] successful.
Aug 16 20:18:02 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75daec95-d394-45eb-bb07-92ed888c2100 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cfa04-b741-4e1d-ab1d-627d15328b12]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] <== disconnect_volume: return (365ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:18:02 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Deleting instance files /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423_del
Aug 16 20:18:02 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Deletion of /opt/stack/data/nova/instances/c4ea94f8-a824-49ae-9671-3dd1d2747423_del complete
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'flavor' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:18:02 user nova-compute[72894]: INFO nova.compute.manager [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8617c711-308b-44af-89a9-708f5dd5cdf5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.200s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.network.neutron [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updated VIF entry in instance network info cache for port 8bbe259d-17fc-48f8-9ae2-748c2b92c28f. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG nova.network.neutron [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [{"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d49bb2e9-3a22-4940-94ee-d9ca3dfe0440 req-768289e9-de3b-4289-bd8b-c124734dab80 service nova] Releasing lock "refresh_cache-6d796fab-6318-4e7b-8a75-ecc4db1db2af" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:18:03 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:03 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Took 1.09 seconds to deallocate network for instance.
Aug 16 20:18:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] Acquiring lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] No waiting events found dispatching network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:03 user nova-compute[72894]: WARNING nova.compute.manager [req-c782b9fa-6fcf-4b26-9a5c-a0073c87189c req-c869ebb5-4737-4fce-a5d2-e3fcf3a3b2db service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received unexpected event network-vif-plugged-1f4ba607-9a2d-4458-bd7d-2833a6f3480a for instance with vm_state active and task_state deleting.
Aug 16 20:18:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-98418ca9-77a0-4509-b253-fd730e322549 req-c76bf25f-9ac0-4a12-a137-fafbe52338ca service nova] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Received event network-vif-deleted-1f4ba607-9a2d-4458-bd7d-2833a6f3480a {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:04 user nova-compute[72894]: INFO nova.compute.manager [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Took 0.91 seconds to detach 1 volumes for instance.
Aug 16 20:18:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:18:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:04 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Deleted allocations for instance c4ea94f8-a824-49ae-9671-3dd1d2747423
Aug 16 20:18:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-8a2b0ed4-771e-4989-868a-a741744dfdd5 tempest-DeleteServersTestJSON-238489581 tempest-DeleteServersTestJSON-238489581-project-member] Lock "c4ea94f8-a824-49ae-9671-3dd1d2747423" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.092s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:16 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217081.8091645, c4ea94f8-a824-49ae-9671-3dd1d2747423 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:18:16 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] VM Stopped (Lifecycle Event)
Aug 16 20:18:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-74bd2d15-fdc8-4f35-8fd3-1e92162b1986 None None] [instance: c4ea94f8-a824-49ae-9671-3dd1d2747423] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:18:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:18:18 user nova-compute[72894]: INFO nova.compute.claims [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Claim successful on node user
Aug 16 20:18:18 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:18 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:18:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.policy [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '181c019980b642c68023ff7283869af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04c911a91a94f6b843ce6d3419e0be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:18:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Creating image(s)
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk 1073741824" returned: 0 in 0.057s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.205s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Successfully created port: 26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Cannot resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'migration_context' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Ensure instance console log exists: /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Successfully updated port: 26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-changed-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Refreshing instance network info cache due to event network-changed-26af5b25-77e0-492e-9991-d35c6d83b0a5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:18:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.neutron [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance network_info: |[{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Refreshing network info cache for port 26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start _get_guest_xml network_info=[{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:18:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:18:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'pci_devices' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:18:21 user nova-compute[72894]:   <uuid>185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</uuid>
Aug 16 20:18:21 user nova-compute[72894]:   <name>instance-00000028</name>
Aug 16 20:18:21 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:18:21 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:18:21 user nova-compute[72894]:   <metadata>
Aug 16 20:18:21 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:18:21 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeTestJSON-server-2064230726</nova:name>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:18:21</nova:creationTime>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:18:21 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:18:21 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:owner>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:user uuid="181c019980b642c68023ff7283869af1">tempest-AttachVolumeTestJSON-1942038190-project-member</nova:user>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:project uuid="c04c911a91a94f6b843ce6d3419e0be1">tempest-AttachVolumeTestJSON-1942038190</nova:project>
Aug 16 20:18:21 user nova-compute[72894]:       </nova:owner>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:18:21 user nova-compute[72894]:       <nova:ports>
Aug 16 20:18:21 user nova-compute[72894]:         <nova:port uuid="26af5b25-77e0-492e-9991-d35c6d83b0a5">
Aug 16 20:18:21 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 20:18:21 user nova-compute[72894]:         </nova:port>
Aug 16 20:18:21 user nova-compute[72894]:       </nova:ports>
Aug 16 20:18:21 user nova-compute[72894]:     </nova:instance>
Aug 16 20:18:21 user nova-compute[72894]:   </metadata>
Aug 16 20:18:21 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:18:21 user nova-compute[72894]:     <system>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="serial">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="uuid">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:18:21 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:18:21 user nova-compute[72894]:     </system>
Aug 16 20:18:21 user nova-compute[72894]:   </sysinfo>
Aug 16 20:18:21 user nova-compute[72894]:   <os>
Aug 16 20:18:21 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:18:21 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:18:21 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:18:21 user nova-compute[72894]:   </os>
Aug 16 20:18:21 user nova-compute[72894]:   <features>
Aug 16 20:18:21 user nova-compute[72894]:     <acpi/>
Aug 16 20:18:21 user nova-compute[72894]:     <apic/>
Aug 16 20:18:21 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:18:21 user nova-compute[72894]:   </features>
Aug 16 20:18:21 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:18:21 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:18:21 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:18:21 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:18:21 user nova-compute[72894]:   </clock>
Aug 16 20:18:21 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:18:21 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:18:21 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:18:21 user nova-compute[72894]:   </cpu>
Aug 16 20:18:21 user nova-compute[72894]:   <devices>
Aug 16 20:18:21 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:18:21 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:18:21 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk"/>
Aug 16 20:18:21 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:18:21 user nova-compute[72894]:     </disk>
Aug 16 20:18:21 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:18:21 user nova-compute[72894]:       <mac address="fa:16:3e:51:67:92"/>
Aug 16 20:18:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:18:21 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:18:21 user nova-compute[72894]:       <target dev="tap26af5b25-77"/>
Aug 16 20:18:21 user nova-compute[72894]:     </interface>
Aug 16 20:18:21 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:18:21 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/console.log" append="off"/>
Aug 16 20:18:21 user nova-compute[72894]:     </serial>
Aug 16 20:18:21 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:18:21 user nova-compute[72894]:     <video>
Aug 16 20:18:21 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:18:21 user nova-compute[72894]:     </video>
Aug 16 20:18:21 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:18:21 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:18:21 user nova-compute[72894]:     </rng>
Aug 16 20:18:21 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:18:21 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:18:21 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:18:21 user nova-compute[72894]:     </memballoon>
Aug 16 20:18:21 user nova-compute[72894]:   </devices>
Aug 16 20:18:21 user nova-compute[72894]: </domain>
Aug 16 20:18:21 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG os_vif [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26af5b25-77, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26af5b25-77, col_values=(('external_ids', {'iface-id': '26af5b25-77e0-492e-9991-d35c6d83b0a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:67:92', 'vm-uuid': '185cb39d-bad2-4e91-9cf3-a1eaba68a0b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:21 user nova-compute[72894]: INFO os_vif [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No VIF found with MAC fa:16:3e:51:67:92, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updated VIF entry in instance network info cache for port 26af5b25-77e0-492e-9991-d35c6d83b0a5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG nova.network.neutron [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-39441361-deb6-4ad5-a572-22e59ceb150a req-6ec1aba6-ba6b-435d-83c8-3429e3a67db9 service nova] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:18:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:23 user nova-compute[72894]: WARNING nova.compute.manager [req-65ff012a-f84a-4aa9-a5f1-61b3dbf595ac req-2506705f-a4bd-4fe9-ac74-58ffb8d1d2d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state building and task_state spawning.
Aug 16 20:18:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217104.9995496, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Resumed (Lifecycle Event)
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance spawned successfully.
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217105.0012977, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Started (Lifecycle Event)
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:25 user nova-compute[72894]: WARNING nova.compute.manager [req-a2a036ad-c148-4484-af00-b6aab77dd88e req-5b188f4b-38ed-4817-941e-24d8ae59d43d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state building and task_state spawning.
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 16 20:18:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:18:25 user nova-compute[72894]: INFO nova.compute.manager [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Took 6.80 seconds to build instance.
Aug 16 20:18:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-2751e83f-8a10-4236-a1ab-49b083ac3db3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.900s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:18:43 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:18:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [{"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:48 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:50 user nova-compute[72894]: INFO nova.compute.manager [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Terminating instance
Aug 16 20:18:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-1875f272-6c48-45e6-8548-3ca2433a00cb req-d5700557-ac8c-4eea-92b6-5542b2e6f07d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-unplugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Instance destroyed successfully.
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid 6d796fab-6318-4e7b-8a75-ecc4db1db2af {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334265123',display_name='tempest-ServerRescueNegativeTestJSON-server-1334265123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334265123',id=32,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8c+TxLZdyhgvXuBb333t0lKDfz6TZXsSOeTUL2YC40/onRwsDL/aUrDbBxX3xo9eKazQbgQdXbPFaHwm77Byu1mNEXyB+5/OmzBNaNRkNDnVWUfTZN3YwIov+4kALGFQ==',key_name='tempest-keypair-1836193020',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-40r73tjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be3a706becb041598d5a63714a389801',uuid=6d796fab-6318-4e7b-8a75-ecc4db1db2af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "address": "fa:16:3e:ea:7b:2a", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bbe259d-17", "ovs_interfaceid": "8bbe259d-17fc-48f8-9ae2-748c2b92c28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG os_vif [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bbe259d-17, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:18:51 user nova-compute[72894]: INFO os_vif [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8bbe259d-17fc-48f8-9ae2-748c2b92c28f,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bbe259d-17')
Aug 16 20:18:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Deleting instance files /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af_del
Aug 16 20:18:51 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Deletion of /opt/stack/data/nova/instances/6d796fab-6318-4e7b-8a75-ecc4db1db2af_del complete
Aug 16 20:18:51 user nova-compute[72894]: INFO nova.compute.manager [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:18:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:18:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:18:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=24.082630157470703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 997cca71-e41a-455e-a02b-854d7fad614b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4a4d6375-4096-455f-8c72-6fc8197c16f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1421be15-19af-4c18-989f-dd13aa3042e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:18:52 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Took 1.30 seconds to deallocate network for instance.
Aug 16 20:18:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-57003543-24cc-4b78-b3b7-2f7cb542a7e5 req-e7101a9a-d2e2-433d-9f14-6c2332bbcbf6 service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-deleted-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] Acquiring lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] No waiting events found dispatching network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:18:53 user nova-compute[72894]: WARNING nova.compute.manager [req-5911cba7-b0ca-4be5-8b6f-e85408c766b9 req-e0717355-ba6d-4487-a912-0fb0924e8b0d service nova] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Received unexpected event network-vif-plugged-8bbe259d-17fc-48f8-9ae2-748c2b92c28f for instance with vm_state deleted and task_state None.
Aug 16 20:18:53 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:18:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:53 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Deleted allocations for instance 6d796fab-6318-4e7b-8a75-ecc4db1db2af
Aug 16 20:18:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bdf25c3a-8214-45c7-93bd-eacf02cc5364 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "6d796fab-6318-4e7b-8a75-ecc4db1db2af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:18:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:18:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:18:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:18:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:02 user nova-compute[72894]: INFO nova.compute.manager [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Attaching volume 2b4d1982-d23a-4fef-a3b6-618858ce1c49 to /dev/vdb
Aug 16 20:19:02 user nova-compute[72894]: DEBUG os_brick.utils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63a660-ec99-4054-9dc6-db222425b917]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9be1e-92c7-45d2-8854-eba3abfd4497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[20979b90-2fea-4a48-b8d2-6e394c64601c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba55f84-48d2-4e18-b4d4-49c3a5cf4bae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:03 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:19:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0821b6b-3975-499e-85ff-c217d574d57d]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG os_brick.utils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:03 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating existing volume attachment record: 9330ea82-cffa-4f67-97ed-49c1694c628f {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:19:06 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217131.4017122, 6d796fab-6318-4e7b-8a75-ecc4db1db2af => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:06 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] VM Stopped (Lifecycle Event)
Aug 16 20:19:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5d74bf29-1130-471b-b56f-316412024531 None None] [instance: 6d796fab-6318-4e7b-8a75-ecc4db1db2af] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IObaGyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:14 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8692bf7-127f-4785-aa7e-7eb1caeccb02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:19:14 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc6716-4ed7-4ca5-aefa-aff03a8036c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49] added
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aea64c-779d-4417-8d21-720ebaa81681]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eed815-0ba9-4549-91bd-a7b7fbb299d2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IObaGyCp {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IObaGyCp" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921afb8-e015-4ec2-bbad-da5570afaa8e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IObaGyCp'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ff400-bd9c-4c6f-ae6f-815ac56bb1ff]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8019ee-262b-4fbc-bae4-44d2d0627c5c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f3e8b-82c9-4bf1-b3f7-8fd62f81322c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260]
Aug 16 20:19:14 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260] successful.
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a92e86-7e5c-4c74-aa37-00175b66178e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f90406-3797-4ad1-891c-9acd648aef38]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:14 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8656867a-64da-41e0-b1d4-ee69104f41d9]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:19:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IObaGyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23462646133633464', 'path': '/dev/sdd'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462646133633464', 'path': '/dev/sdd'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:19:15 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:19:15 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:19:15 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:19:15 user nova-compute[72894]:   <serial>2b4d1982-d23a-4fef-a3b6-618858ce1c49</serial>
Aug 16 20:19:15 user nova-compute[72894]: </disk>
Aug 16 20:19:15 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] No VIF found with MAC fa:16:3e:e3:e7:c5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-061d7037-33f4-46c4-b0cc-6fb468833a00 tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.604s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing instance network info cache due to event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] Acquiring lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] Acquired lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updated VIF entry in instance network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating instance_info_cache with network_info: [{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b8536de0-3d20-4792-9238-8870c4bc3f0f req-b89c0353-0992-4d62-bdd9-362bf78a4f32 service nova] Releasing lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing instance network info cache due to event network-changed-a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] Acquiring lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] Acquired lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Refreshing network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:17 user nova-compute[72894]: INFO nova.compute.manager [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Terminating instance
Aug 16 20:19:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updated VIF entry in instance network info cache for port a9a1a861-90dd-402d-bd8a-48d95ff19b7c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating instance_info_cache with network_info: [{"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3273eabe-a720-4f9a-9cbd-fb8722805326 req-64f47c05-3802-4518-a640-16cb5ce7ebcc service nova] Releasing lock "refresh_cache-4a4d6375-4096-455f-8c72-6fc8197c16f0" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Instance destroyed successfully.
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid 4a4d6375-4096-455f-8c72-6fc8197c16f0 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-154719082',display_name='tempest-TestVolumeBootPattern-server-154719082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-154719082',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-f0jsjj0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:17:50Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=4a4d6375-4096-455f-8c72-6fc8197c16f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "address": "fa:16:3e:52:e4:ba", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a1a861-90", "ovs_interfaceid": "a9a1a861-90dd-402d-bd8a-48d95ff19b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_vif [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9a1a861-90, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:19:18 user nova-compute[72894]: INFO os_vif [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e4:ba,bridge_name='br-int',has_traffic_filtering=True,id=a9a1a861-90dd-402d-bd8a-48d95ff19b7c,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a1a861-90')
Aug 16 20:19:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdEGIlzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:18 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f096bd56-5590-4e0c-9271-47d814f34e09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b12b19-f555-4a36-b70e-c63c5bd94666]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:18 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:18 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:18 user nova-compute[72894]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e (non-flash)
Aug 16 20:19:18 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4afa950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[946cf418-2bdb-4ab7-9caa-0c210be27ab3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4ffa8-a979-4a25-a341-00e9a851f77b]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[177611ed-f5a4-4b3f-a992-bae6ac75bef6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:19:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.164s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89cd75-4b17-4cdf-8713-3dc7d1d8f658]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23538393437303564', '/dev/disk/by-id/scsi-1SCST_BIO6c04ad98-5894705d21b9fed7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c04ad98') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fe44d-13c6-482e-b7c0-396343335f73]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268de6b-5bae-4953-8ab8-3da357d7e2b4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[59634e9a-3b2e-4afe-9bf4-f8c0a8aa732f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260]
Aug 16 20:19:19 user nova-compute[72894]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e, portal: 172.16.0.220,3260] successful.
Aug 16 20:19:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:703d0f0f-3659-4837-8177-9f7f7d7ed61e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbccf7f9-ec09-4a14-99db-43239078f6d1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (439ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:19:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Deleting instance files /opt/stack/data/nova/instances/4a4d6375-4096-455f-8c72-6fc8197c16f0_del
Aug 16 20:19:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Deletion of /opt/stack/data/nova/instances/4a4d6375-4096-455f-8c72-6fc8197c16f0_del complete
Aug 16 20:19:19 user nova-compute[72894]: INFO nova.compute.manager [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-unplugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] No waiting events found dispatching network-vif-unplugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-unplugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Acquiring lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] No waiting events found dispatching network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:19 user nova-compute[72894]: WARNING nova.compute.manager [req-389830bc-c780-43c7-8f69-8d4f5afed0a7 req-20716982-a57e-4686-9881-dbd1358968d5 service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received unexpected event network-vif-plugged-a9a1a861-90dd-402d-bd8a-48d95ff19b7c for instance with vm_state active and task_state deleting.
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:20 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Took 1.15 seconds to deallocate network for instance.
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing instance network info cache due to event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-472a7bd3-6a90-47a2-abbd-d4c2939fed63 req-f898255b-cca6-426d-ae51-98d3f79a4bcf service nova] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Received event network-vif-deleted-a9a1a861-90dd-402d-bd8a-48d95ff19b7c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated VIF entry in instance network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:20 user nova-compute[72894]: DEBUG nova.network.neutron [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c854efb7-35cf-4a9c-879d-8feb0b956e13 req-581eb91d-452b-4974-8d01-ca0638de9eb6 service nova] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:21 user nova-compute[72894]: INFO nova.compute.manager [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Took 0.89 seconds to detach 1 volumes for instance.
Aug 16 20:19:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:21 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:19:21 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:19:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:22 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance 4a4d6375-4096-455f-8c72-6fc8197c16f0
Aug 16 20:19:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf9d94f2-4846-4ba1-862e-6a0780cf02d0 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "4a4d6375-4096-455f-8c72-6fc8197c16f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.201s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing instance network info cache due to event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:23 user nova-compute[72894]: INFO nova.compute.manager [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Rebooting instance
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated VIF entry in instance network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f5b830fb-d8b4-4268-a3e5-63c9f39edd8d req-937f0981-8f5d-4882-a13b-773d2c73a0d6 service nova] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:19:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:19:24 user nova-compute[72894]: INFO nova.compute.claims [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Claim successful on node user
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:19:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:19:24 user nova-compute[72894]: INFO nova.virt.block_device [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Booting with volume c5dd7596-366f-4136-a5a4-3741ae48b0d7 at /dev/vda
Aug 16 20:19:24 user nova-compute[72894]: DEBUG nova.policy [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18c762f5c7c049b5a6b765b1345248c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b368143e912d44a1adb66a8ae084dcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.utils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[449bcfcd-5c46-44d3-a9a7-73f630ebcbd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaa574b-80ac-4ac4-95d4-59c684c3bf8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28d9f15-589a-4750-8d2c-5cdfc91bd66f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf313c4-46a3-459b-8bda-a8c53275ae4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:25 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:19:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7cb17-828a-45af-8cce-e74b3396b283]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG os_brick.utils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating existing volume attachment record: 06fe895f-ca2f-4e46-9860-3935deed1506 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:19:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Successfully created port: e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Successfully updated port: e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquired lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-changed-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Refreshing instance network info cache due to event network-changed-e73a954c-f9ca-41cf-b016-c67301a63216. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] Acquiring lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance shutdown successfully.
Aug 16 20:19:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating instance_info_cache with network_info: [{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Releasing lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance network_info: |[{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] Acquired lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:27 user nova-compute[72894]: DEBUG nova.network.neutron [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Refreshing network info cache for port e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updated VIF entry in instance network info cache for port e73a954c-f9ca-41cf-b016-c67301a63216. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.network.neutron [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating instance_info_cache with network_info: [{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cfee081d-9b07-4665-9c76-c8a31a81ebba req-6ae0e5cc-57a8-4fed-87e9-79497bed03be service nova] Releasing lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:28 user nova-compute[72894]: WARNING nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:28 user nova-compute[72894]: WARNING nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:28 user nova-compute[72894]: WARNING nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:28 user nova-compute[72894]: WARNING nova.compute.manager [req-bf2ca1a0-c0a4-4a14-8692-7013d2b8d736 req-0e61e448-f6f3-43dc-84bb-8b68b7743a3c service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:30 user nova-compute[72894]: WARNING nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:30 user nova-compute[72894]: WARNING nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:30 user nova-compute[72894]: WARNING nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:30 user nova-compute[72894]: WARNING nova.compute.manager [req-5ca8b73c-ee39-456e-b54f-1b79b272f559 req-5600a5e2-1c51-4a01-b544-307ea2ab8a77 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state active and task_state reboot_started.
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 997cca71-e41a-455e-a02b-854d7fad614b due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217171.159404, 997cca71-e41a-455e-a02b-854d7fad614b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:31 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] VM Resumed (Lifecycle Event)
Aug 16 20:19:31 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance running successfully.
Aug 16 20:19:31 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance soft rebooted successfully.
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:19:31 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217171.1617894, 997cca71-e41a-455e-a02b-854d7fad614b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:31 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] VM Started (Lifecycle Event)
Aug 16 20:19:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1bcaba03-4dc6-472a-be84-99109e004ffc tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.648s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:19:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing instance network info cache due to event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:19:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] Acquiring lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] Acquired lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:32 user nova-compute[72894]: DEBUG nova.network.neutron [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:33 user nova-compute[72894]: INFO nova.compute.manager [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Attaching volume 71e8707f-7251-4387-9e55-f59ddb4d4c40 to /dev/vdb
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ab4a1-26e1-4cb3-9ef0-689ab24e2a2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b015469-be4c-4e14-8303-3653bc94b245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc927e-34ce-49ca-a7da-343a78f767df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8c47a-3bb3-4a22-b393-4f749b623d5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:19:33 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f33183e-7b98-4865-abb7-6b240ee568fd]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG os_brick.utils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating existing volume attachment record: 49825017-cc14-4d6c-a625-4dd685b4bfa6 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updated VIF entry in instance network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.network.neutron [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating instance_info_cache with network_info: [{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-59e68666-42eb-4c28-bd8e-ab4a85f98cc8 req-1347707c-f2fe-4d9d-8363-39e63eb18d6b service nova] Releasing lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217158.710495, 4a4d6375-4096-455f-8c72-6fc8197c16f0 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:33 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] VM Stopped (Lifecycle Event)
Aug 16 20:19:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-904dd516-272e-4a78-a933-3dd02415be08 None None] [instance: 4a4d6375-4096-455f-8c72-6fc8197c16f0] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:19:37 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Creating image(s)
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Ensure instance console log exists: /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start _get_guest_xml network_info=[{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '06fe895f-ca2f-4e46-9860-3935deed1506', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d337a32-9e8d-49b4-a87c-46b4eb79b616', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5dd7596-366f-4136-a5a4-3741ae48b0d7', 'serial': 'c5dd7596-366f-4136-a5a4-3741ae48b0d7'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:19:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:19:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:37 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:37 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:37 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adcfb99-9137-4bec-a8e2-6b027a9ca093]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:19:37 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c68c5-3a37-41d1-9a89-b2f7e6a43049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7] added
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccbbe3e-2780-491c-af2e-d7c22546302a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[65810f84-cfaf-47b6-b5e7-c9c27f6197ce]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSYzJeWV {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSYzJeWV" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05fd979-f14b-46fb-a80c-82465a90e67a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSYzJeWV'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00348ded-48c1-4aa9-ab09-9e14752ae7dd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3498a2ff-8f19-449d-aad9-9fc732cc1b20]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c944c02a-61c6-4b98-bff7-6d086fc8fb74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]
Aug 16 20:19:37 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bce4f6-aee2-44a5-bc73-009d901f7e57]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3465806-e019-4a82-97e7-65461d8bec62]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e990d658-8045-4d10-92b2-5a67c0f774cc]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23030653839646538', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653839646538', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-944612676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:19:38 user nova-compute[72894]:   <uuid>7d337a32-9e8d-49b4-a87c-46b4eb79b616</uuid>
Aug 16 20:19:38 user nova-compute[72894]:   <name>instance-00000029</name>
Aug 16 20:19:38 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:19:38 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:19:38 user nova-compute[72894]:   <metadata>
Aug 16 20:19:38 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:19:38 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:19:38 user nova-compute[72894]:       <nova:name>tempest-ServerActionsV293TestJSON-server-944612676</nova:name>
Aug 16 20:19:38 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:19:37</nova:creationTime>
Aug 16 20:19:38 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:19:38 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:19:38 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:19:38 user nova-compute[72894]:       <nova:owner>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:user uuid="18c762f5c7c049b5a6b765b1345248c3">tempest-ServerActionsV293TestJSON-870577737-project-member</nova:user>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:project uuid="b368143e912d44a1adb66a8ae084dcea">tempest-ServerActionsV293TestJSON-870577737</nova:project>
Aug 16 20:19:38 user nova-compute[72894]:       </nova:owner>
Aug 16 20:19:38 user nova-compute[72894]:       <nova:ports>
Aug 16 20:19:38 user nova-compute[72894]:         <nova:port uuid="e73a954c-f9ca-41cf-b016-c67301a63216">
Aug 16 20:19:38 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:19:38 user nova-compute[72894]:         </nova:port>
Aug 16 20:19:38 user nova-compute[72894]:       </nova:ports>
Aug 16 20:19:38 user nova-compute[72894]:     </nova:instance>
Aug 16 20:19:38 user nova-compute[72894]:   </metadata>
Aug 16 20:19:38 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:19:38 user nova-compute[72894]:     <system>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="serial">7d337a32-9e8d-49b4-a87c-46b4eb79b616</entry>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="uuid">7d337a32-9e8d-49b4-a87c-46b4eb79b616</entry>
Aug 16 20:19:38 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:19:38 user nova-compute[72894]:     </system>
Aug 16 20:19:38 user nova-compute[72894]:   </sysinfo>
Aug 16 20:19:38 user nova-compute[72894]:   <os>
Aug 16 20:19:38 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:19:38 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:19:38 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:19:38 user nova-compute[72894]:   </os>
Aug 16 20:19:38 user nova-compute[72894]:   <features>
Aug 16 20:19:38 user nova-compute[72894]:     <acpi/>
Aug 16 20:19:38 user nova-compute[72894]:     <apic/>
Aug 16 20:19:38 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:19:38 user nova-compute[72894]:   </features>
Aug 16 20:19:38 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:19:38 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:19:38 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:19:38 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:19:38 user nova-compute[72894]:   </clock>
Aug 16 20:19:38 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:19:38 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:19:38 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:19:38 user nova-compute[72894]:   </cpu>
Aug 16 20:19:38 user nova-compute[72894]:   <devices>
Aug 16 20:19:38 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:19:38 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:19:38 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:19:38 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:19:38 user nova-compute[72894]:       <serial>c5dd7596-366f-4136-a5a4-3741ae48b0d7</serial>
Aug 16 20:19:38 user nova-compute[72894]:     </disk>
Aug 16 20:19:38 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:19:38 user nova-compute[72894]:       <mac address="fa:16:3e:b4:1b:85"/>
Aug 16 20:19:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:19:38 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:19:38 user nova-compute[72894]:       <target dev="tape73a954c-f9"/>
Aug 16 20:19:38 user nova-compute[72894]:     </interface>
Aug 16 20:19:38 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:19:38 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616/console.log" append="off"/>
Aug 16 20:19:38 user nova-compute[72894]:     </serial>
Aug 16 20:19:38 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:19:38 user nova-compute[72894]:     <video>
Aug 16 20:19:38 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:19:38 user nova-compute[72894]:     </video>
Aug 16 20:19:38 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:19:38 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:19:38 user nova-compute[72894]:     </rng>
Aug 16 20:19:38 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:19:38 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:19:38 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:19:38 user nova-compute[72894]:     </memballoon>
Aug 16 20:19:38 user nova-compute[72894]:   </devices>
Aug 16 20:19:38 user nova-compute[72894]: </domain>
Aug 16 20:19:38 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-944612676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG os_vif [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape73a954c-f9, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape73a954c-f9, col_values=(('external_ids', {'iface-id': 'e73a954c-f9ca-41cf-b016-c67301a63216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:1b:85', 'vm-uuid': '7d337a32-9e8d-49b4-a87c-46b4eb79b616'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:38 user nova-compute[72894]: INFO os_vif [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9')
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:19:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] No VIF found with MAC fa:16:3e:b4:1b:85, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:19:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:40 user nova-compute[72894]: WARNING nova.compute.manager [req-d8c6697c-5b0f-4c63-b34a-2bb2a16ded9f req-434e8a59-c8b4-4360-ba07-d2de3f471067 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state building and task_state spawning.
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217182.5270257, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Resumed (Lifecycle Event)
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance spawned successfully.
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217182.5287316, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Started (Lifecycle Event)
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:42 user nova-compute[72894]: WARNING nova.compute.manager [req-a97baa3d-9c2f-4fc1-b9c2-38d84593eb92 req-66f93271-87ca-4fc3-9a06-727248df9d12 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state building and task_state spawning.
Aug 16 20:19:42 user nova-compute[72894]: INFO nova.compute.manager [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Took 18.41 seconds to build instance.
Aug 16 20:19:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b6f44db7-9edc-40b1-a3b0-89017fda6a2f tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.572s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQXOWdjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:45 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:45 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d0741-4275-4bd8-9b2b-6e5bf1fc7cf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:19:45 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e808fe6b-ec42-47f3-9fe8-1bde08f9d688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40] added
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1986de3a-7dd3-43cf-8517-b424a5baf632]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e190d-fa59-45dc-8236-46a3be7c414a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQXOWdjo {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQXOWdjo" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af29ceb-c986-4eaf-ae4c-7bb983a5dfc8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQXOWdjo'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[585cfc75-190d-4fbf-911b-e4bbf79e01a7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcac03be-9662-4f65-8a51-0eb17ad03de0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[804520fd-c136-44b7-bc0c-f19e16577b2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260]
Aug 16 20:19:45 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260] successful.
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[714e1b0d-7568-44dd-a553-22833a5eef1e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30059a1b-145c-47aa-af72-78a403042c3b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)
Aug 16 20:19:45 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b62ce2-aff6-4409-9400-269bca2e6690]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:45 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQXOWdjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23937353866646237', 'path': '/dev/sde'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937353866646237', 'path': '/dev/sde'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:19:46 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:19:46 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:19:46 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:19:46 user nova-compute[72894]:   <serial>71e8707f-7251-4387-9e55-f59ddb4d4c40</serial>
Aug 16 20:19:46 user nova-compute[72894]: </disk>
Aug 16 20:19:46 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:19:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:19:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:19:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] No VIF found with MAC fa:16:3e:e8:5a:d5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:19:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ca74747c-84bc-42d9-bfd4-29cb53581ca9 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.292s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:49 user nova-compute[72894]: INFO nova.compute.manager [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Detaching volume 71e8707f-7251-4387-9e55-f59ddb4d4c40
Aug 16 20:19:49 user nova-compute[72894]: INFO nova.virt.block_device [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Attempting to driver detach volume 71e8707f-7251-4387-9e55-f59ddb4d4c40 from mountpoint /dev/vdb
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Attempting to detach device vdb from instance 1421be15-19af-4c18-989f-dd13aa3042e7 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:19:49 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:19:49 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:19:49 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:19:49 user nova-compute[72894]:   <serial>71e8707f-7251-4387-9e55-f59ddb4d4c40</serial>
Aug 16 20:19:49 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:19:49 user nova-compute[72894]: </disk>
Aug 16 20:19:49 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:19:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully detached device vdb from instance 1421be15-19af-4c18-989f-dd13aa3042e7 from the persistent domain config.
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1421be15-19af-4c18-989f-dd13aa3042e7 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:19:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:19:49 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:19:49 user nova-compute[72894]:   <source dev="/dev/sde"/>
Aug 16 20:19:49 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:19:49 user nova-compute[72894]:   <serial>71e8707f-7251-4387-9e55-f59ddb4d4c40</serial>
Aug 16 20:19:49 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:19:49 user nova-compute[72894]: </disk>
Aug 16 20:19:49 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217190.218521, 1421be15-19af-4c18-989f-dd13aa3042e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:19:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully detached device vdb from instance 1421be15-19af-4c18-989f-dd13aa3042e7 from the live domain config.
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQXOWdjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:19:50 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b44d6b-8141-42de-a7ae-cbd97e6ab164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93714b9-2a23-41b4-9569-e90f08f764fc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 (non-flash)
Aug 16 20:19:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79906355a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40'): ({'sde'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Removing single pathed devices sde {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a61b7b-39bc-456a-bb0b-75e3363de646]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc413d-034e-4886-9c3b-831357f078db]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Flushing IO for device /dev/sde {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d440d2-f9c2-4b3a-9bd1-68c26a0f281c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c2afd-9c54-472f-9f11-f629cc4ecc4f]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] SCSI volumes sde have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a80410c-eea2-4b07-8612-161f3428c4d6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00472053-e256-4ab7-bfe7-92fa5a278300]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260]
Aug 16 20:19:50 user nova-compute[72894]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40, portal: 172.16.0.220,3260] successful.
Aug 16 20:19:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e8707f-7251-4387-9e55-f59ddb4d4c40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39e428-4ddc-48ae-916d-3e9ab1b6c5bb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] <== disconnect_volume: return (374ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'flavor' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-050cdd33-74a5-4624-8790-035638fabcd8 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:19:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:19:53 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:19:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=24.094684600830078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60dd6c6f-825a-4367-a215-c3989d1db134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 997cca71-e41a-455e-a02b-854d7fad614b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 1421be15-19af-4c18-989f-dd13aa3042e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:19:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:57 user nova-compute[72894]: INFO nova.compute.manager [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Terminating instance
Aug 16 20:19:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-6701a0d4-da3f-485a-b9b1-46bdf9ab8640 req-4fac8041-5ca3-4aa7-99ea-d4b60fb7ea59 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-unplugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Instance destroyed successfully.
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1226330475',display_name='tempest-ServerRescueNegativeTestJSON-server-1226330475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1226330475',id=19,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:05:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-pzm3fhnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:05:30Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=af992d03-c0d8-4ebf-92d9-cb51f74a7fd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "1d63be3e-9879-4357-bcb6-23772caadd62", "address": "fa:16:3e:4d:8f:e9", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d63be3e-98", "ovs_interfaceid": "1d63be3e-9879-4357-bcb6-23772caadd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG os_vif [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d63be3e-98, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:19:58 user nova-compute[72894]: INFO os_vif [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:8f:e9,bridge_name='br-int',has_traffic_filtering=True,id=1d63be3e-9879-4357-bcb6-23772caadd62,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d63be3e-98')
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Deleting instance files /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2_del
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Deletion of /opt/stack/data/nova/instances/af992d03-c0d8-4ebf-92d9-cb51f74a7fd2_del complete
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.compute.manager [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 20:19:58 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Took 0.57 seconds to deallocate network for instance.
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3d8ee7b1-2e31-4920-8fe2-d3766ad6bb07 req-9fbfec9f-3324-4bf3-9de8-671ad0f3bb5c service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-deleted-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:58 user nova-compute[72894]: INFO nova.compute.manager [req-3d8ee7b1-2e31-4920-8fe2-d3766ad6bb07 req-9fbfec9f-3324-4bf3-9de8-671ad0f3bb5c service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Neutron deleted interface 1d63be3e-9879-4357-bcb6-23772caadd62; detaching it from the instance and deleting it from the info cache
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.network.neutron [req-3d8ee7b1-2e31-4920-8fe2-d3766ad6bb07 req-9fbfec9f-3324-4bf3-9de8-671ad0f3bb5c service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3d8ee7b1-2e31-4920-8fe2-d3766ad6bb07 req-9fbfec9f-3324-4bf3-9de8-671ad0f3bb5c service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Detach interface failed, port_id=1d63be3e-9879-4357-bcb6-23772caadd62, reason: Instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:59 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Deleted allocations for instance af992d03-c0d8-4ebf-92d9-cb51f74a7fd2
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3caf9671-31fa-4cc5-9fd5-0b2355ce23f5 tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.007s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] Acquiring lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] Lock "af992d03-c0d8-4ebf-92d9-cb51f74a7fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:19:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] No waiting events found dispatching network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:19:59 user nova-compute[72894]: WARNING nova.compute.manager [req-42ccb69a-7cd0-49bf-9c01-272d5266ac67 req-ffc8611b-18ef-4bd3-b70e-534b5ae65382 service nova] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Received unexpected event network-vif-plugged-1d63be3e-9879-4357-bcb6-23772caadd62 for instance with vm_state deleted and task_state None.
Aug 16 20:20:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-changed-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Refreshing instance network info cache due to event network-changed-26af5b25-77e0-492e-9991-d35c6d83b0a5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:20:09 user nova-compute[72894]: DEBUG nova.network.neutron [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Refreshing network info cache for port 26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:20:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updated VIF entry in instance network info cache for port 26af5b25-77e0-492e-9991-d35c6d83b0a5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:20:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-37f44a16-8591-475e-a699-5e4481d4cee8 req-aa3feae1-f7ec-426b-92fc-5fc31a79bee5 service nova] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:20:13 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217198.1237972, af992d03-c0d8-4ebf-92d9-cb51f74a7fd2 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:13 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] VM Stopped (Lifecycle Event)
Aug 16 20:20:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-39116c0b-a263-4d1b-bcfb-452563f1b967 None None] [instance: af992d03-c0d8-4ebf-92d9-cb51f74a7fd2] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:16 user nova-compute[72894]: INFO nova.compute.manager [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Attaching volume c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae to /dev/vdb
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.utils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfcbb7-c8ef-453e-90c3-814829b1e79a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa203ef-b1f3-4cea-8531-734662da4285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c0784-a7be-4745-ae02-55a32072a666]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0423c5-4b30-49cd-9077-0d8a10f3d031]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:20:16 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:20:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[717255ba-2423-4d69-b714-f480aa63b086]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG os_brick.utils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:20:16 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating existing volume attachment record: 9a98cf3c-5540-4a5c-834c-2e2407e7830d {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:20:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing instance network info cache due to event network-changed-1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] Acquiring lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] Acquired lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Refreshing network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:23 user nova-compute[72894]: INFO nova.compute.manager [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Terminating instance
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-unplugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] No waiting events found dispatching network-vif-unplugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-f9071b41-8e94-4b5a-a903-851414c89899 req-a0897bc0-b37b-4ae2-beb1-f7984e1ff796 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-unplugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updated VIF entry in instance network info cache for port 1f9ce887-51bb-4d6a-b40d-045d82f93b25. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.network.neutron [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [{"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c31f1e0f-f0b3-4a9e-a1fc-74e201e85055 req-b4fb5b4d-d7d2-4560-afc6-4acc08e31b2c service nova] Releasing lock "refresh_cache-60cd43b9-f661-4a6f-a791-1969f5b66f8d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:20:23 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Instance destroyed successfully.
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lazy-loading 'resources' on Instance uuid 60cd43b9-f661-4a6f-a791-1969f5b66f8d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592000340',display_name='tempest-TestVolumeBootPattern-server-1592000340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592000340',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7xji+PRwrVWVVb2DTA29x0QLnj/j+Wb+V0CO62yRi09hgQB+UFpZ+f0855UCC9b8UzK5Ye4A5Pq4QhBvGMeNo0mF9gUyO8SJcd8IuWaeQSNpWfaIRukAazTu+v+h1uw==',key_name='tempest-TestVolumeBootPattern-1437018970',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0dcce533e44566820c42e5d984ce38',ramdisk_id='',reservation_id='r-i5tgxqhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1700099963',owner_user_name='tempest-TestVolumeBootPattern-1700099963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:15:34Z,user_data=None,user_id='e4b7460311d94421a6015c08fa900e6c',uuid=60cd43b9-f661-4a6f-a791-1969f5b66f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converting VIF {"id": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "address": "fa:16:3e:87:25:0d", "network": {"id": "0744a173-eefd-446f-95a6-a5c567df1923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-772315975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0dcce533e44566820c42e5d984ce38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ce887-51", "ovs_interfaceid": "1f9ce887-51bb-4d6a-b40d-045d82f93b25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG os_vif [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f9ce887-51, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:20:24 user nova-compute[72894]: INFO os_vif [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=1f9ce887-51bb-4d6a-b40d-045d82f93b25,network=Network(0744a173-eefd-446f-95a6-a5c567df1923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ce887-51')
Aug 16 20:20:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQDhdtrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:20:24 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e82aac-1d65-4ef0-9b0e-2b72dea5a927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2801042-571a-43f1-9dd8-e51dba0a8bd3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:20:24 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:24 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d (non-flash)
Aug 16 20:20:24 user nova-compute[72894]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:24 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c696dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6046fb-fffd-465c-9247-52a77abd67eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03301d2-2d7d-40f5-affe-6fbac4f06019]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[361aab34-62a9-45b6-8955-d7474219a992]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842cf1c-e1e2-433e-b11c-d777063257b2]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23963626639336361', '/dev/disk/by-id/scsi-1SCST_BIO5432d50f-9cbf93caae2a9d3d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5432d50f') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed111c-662b-4bf1-a746-c59651fdbeed]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d25a4-53f8-4294-95a9-51ee2a95a2d9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2354fd-ef7a-417e-9b56-367087b638a8]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260]
Aug 16 20:20:24 user nova-compute[72894]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d, portal: 172.16.0.220,3260] successful.
Aug 16 20:20:24 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:733e6986-36f7-483c-93f7-f6bae2b4ff2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f704c4f6-f2c7-4e3d-b71b-9fe6a1f57c23]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] <== disconnect_volume: return (330ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:20:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Deleting instance files /opt/stack/data/nova/instances/60cd43b9-f661-4a6f-a791-1969f5b66f8d_del
Aug 16 20:20:24 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Deletion of /opt/stack/data/nova/instances/60cd43b9-f661-4a6f-a791-1969f5b66f8d_del complete
Aug 16 20:20:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:24 user nova-compute[72894]: INFO nova.compute.manager [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 16 20:20:24 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:20:24 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:25 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Took 0.87 seconds to deallocate network for instance.
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-88be87f2-a478-45b0-ac6f-2c449a2d4749 req-d2c342b7-0e00-43f0-abbe-12ccc2d8c670 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-deleted-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:25 user nova-compute[72894]: INFO nova.compute.manager [req-88be87f2-a478-45b0-ac6f-2c449a2d4749 req-d2c342b7-0e00-43f0-abbe-12ccc2d8c670 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Neutron deleted interface 1f9ce887-51bb-4d6a-b40d-045d82f93b25; detaching it from the instance and deleting it from the info cache
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.network.neutron [req-88be87f2-a478-45b0-ac6f-2c449a2d4749 req-d2c342b7-0e00-43f0-abbe-12ccc2d8c670 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-88be87f2-a478-45b0-ac6f-2c449a2d4749 req-d2c342b7-0e00-43f0-abbe-12ccc2d8c670 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Detach interface failed, port_id=1f9ce887-51bb-4d6a-b40d-045d82f93b25, reason: Instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] Acquiring lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] No waiting events found dispatching network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:25 user nova-compute[72894]: WARNING nova.compute.manager [req-d3e5167e-0e18-4a35-b2fd-9df4343b596d req-5578239a-7986-493e-b811-d3478ea01cb6 service nova] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Received unexpected event network-vif-plugged-1f9ce887-51bb-4d6a-b40d-045d82f93b25 for instance with vm_state active and task_state deleting.
Aug 16 20:20:26 user nova-compute[72894]: INFO nova.compute.manager [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Took 0.87 seconds to detach 1 volumes for instance.
Aug 16 20:20:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:26 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:20:26 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:20:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:26 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Deleted allocations for instance 60cd43b9-f661-4a6f-a791-1969f5b66f8d
Aug 16 20:20:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d07f9960-18e6-4d53-b284-a401783b5c08 tempest-TestVolumeBootPattern-1700099963 tempest-TestVolumeBootPattern-1700099963-project-member] Lock "60cd43b9-f661-4a6f-a791-1969f5b66f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.462s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:20:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:20:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:20:28 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebaf8bd-5534-4254-b83b-991ec66b8fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:20:28 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb1a5e1-3d54-44c5-9754-5f25fffb4b0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae] added
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19c3cb-62b5-4120-a9d3-3683aa6e0d6d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeebf8cc-602a-403d-ae25-0cf1f2c4433b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJKdOrbL {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJKdOrbL" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bec75b-5943-4858-8040-8748a9a69c38]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJKdOrbL'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6436ed-bb08-4bbd-8613-6965df96e99d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[713a7389-6f10-4740-b864-b2fd2954cc60]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[605944f0-8969-4421-bac5-94d46393fde8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]
Aug 16 20:20:28 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ed0a5-34de-4096-8d15-7640a51c3659]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304137b-9f78-43ef-97bf-43efb1356509]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:20:28 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:20:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b3d28-64f0-4d6c-a351-d66decfbbd6d]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:20:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26561393736323231', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561393736323231', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:20:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:20:29 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:20:29 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:20:29 user nova-compute[72894]:   <serial>c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae</serial>
Aug 16 20:20:29 user nova-compute[72894]: </disk>
Aug 16 20:20:29 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:20:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No VIF found with MAC fa:16:3e:51:67:92, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:20:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fc6598b3-48d1-4eb5-98e1-0ea09da2aa30 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.936s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72894) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:31 user nova-compute[72894]: DEBUG nova.compute.manager [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:31 user nova-compute[72894]: WARNING nova.compute.manager [req-a0d4a7ca-1fda-40f8-8416-5df308b274e3 req-bbaa1aa3-e48c-47ca-aff6-666ed863a999 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state active and task_state powering-off.
Aug 16 20:20:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance destroyed successfully.
Aug 16 20:20:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-36748ff8-1163-4554-bf17-1df78ceb8611 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.848s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:33 user nova-compute[72894]: DEBUG nova.compute.manager [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:33 user nova-compute[72894]: WARNING nova.compute.manager [req-f394d65d-c72d-4631-8034-1d4d0dcea668 req-dffb5e3b-f166-4c7b-99fa-d921c246c4ed service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state None.
Aug 16 20:20:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:20:38 user nova-compute[72894]: INFO nova.compute.claims [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Claim successful on node user
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:20:38 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217223.9600186, 60cd43b9-f661-4a6f-a791-1969f5b66f8d => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:38 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] VM Stopped (Lifecycle Event)
Aug 16 20:20:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-721c712c-ee09-45df-8822-593bf3e8f21b None None] [instance: 60cd43b9-f661-4a6f-a791-1969f5b66f8d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:20:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Creating image(s)
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "/opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "/opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "/opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.policy [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '595bc127800b4db694720926fe6da359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fc019b63604cc294c4899d7eee3e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.189s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk 1073741824" returned: 0 in 0.061s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Successfully created port: 8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Cannot resize image /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lazy-loading 'migration_context' on Instance uuid 038a6f72-a311-4c28-84b1-119fce57baee {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Ensure instance console log exists: /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing instance network info cache due to event network-changed-0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] Acquiring lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] Acquired lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.network.neutron [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Refreshing network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:40 user nova-compute[72894]: INFO nova.compute.manager [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Terminating instance
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Successfully updated port: 8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquired lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-changed-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Refreshing instance network info cache due to event network-changed-8a59c520-5b2d-49d3-a7b8-b556a593fa7d. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:20:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] Acquiring lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updated VIF entry in instance network info cache for port 0ee585fc-2800-4171-a8f4-de40cb744eb5. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating instance_info_cache with network_info: [{"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e909f72c-cd40-4e26-9da6-747109c76c87 req-20ad5ece-bab6-469b-8f2c-b3ab36be22ff service nova] Releasing lock "refresh_cache-1421be15-19af-4c18-989f-dd13aa3042e7" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Updating instance_info_cache with network_info: [{"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Releasing lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Instance network_info: |[{"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] Acquired lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Refreshing network info cache for port 8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Start _get_guest_xml network_info=[{"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:20:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:20:41 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33731133',display_name='tempest-VolumesNegativeTest-instance-33731133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33731133',id=42,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fc019b63604cc294c4899d7eee3e7b',ramdisk_id='',reservation_id='r-8hct0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-430496650',owner_user_name='tempest-VolumesNegativeTest-430496650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:20:39Z,user_data=None,user_id='595bc127800b4db694720926fe6da359',uuid=038a6f72-a311-4c28-84b1-119fce57baee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converting VIF {"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lazy-loading 'pci_devices' on Instance uuid 038a6f72-a311-4c28-84b1-119fce57baee {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:20:41 user nova-compute[72894]:   <uuid>038a6f72-a311-4c28-84b1-119fce57baee</uuid>
Aug 16 20:20:41 user nova-compute[72894]:   <name>instance-0000002a</name>
Aug 16 20:20:41 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:20:41 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:20:41 user nova-compute[72894]:   <metadata>
Aug 16 20:20:41 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:20:41 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:name>tempest-VolumesNegativeTest-instance-33731133</nova:name>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:20:41</nova:creationTime>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:20:41 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:20:41 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:owner>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:user uuid="595bc127800b4db694720926fe6da359">tempest-VolumesNegativeTest-430496650-project-member</nova:user>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:project uuid="a5fc019b63604cc294c4899d7eee3e7b">tempest-VolumesNegativeTest-430496650</nova:project>
Aug 16 20:20:41 user nova-compute[72894]:       </nova:owner>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:20:41 user nova-compute[72894]:       <nova:ports>
Aug 16 20:20:41 user nova-compute[72894]:         <nova:port uuid="8a59c520-5b2d-49d3-a7b8-b556a593fa7d">
Aug 16 20:20:41 user nova-compute[72894]:           <nova:ip type="fixed" address="192.168.233.26" ipVersion="4"/>
Aug 16 20:20:41 user nova-compute[72894]:         </nova:port>
Aug 16 20:20:41 user nova-compute[72894]:       </nova:ports>
Aug 16 20:20:41 user nova-compute[72894]:     </nova:instance>
Aug 16 20:20:41 user nova-compute[72894]:   </metadata>
Aug 16 20:20:41 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:20:41 user nova-compute[72894]:     <system>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="serial">038a6f72-a311-4c28-84b1-119fce57baee</entry>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="uuid">038a6f72-a311-4c28-84b1-119fce57baee</entry>
Aug 16 20:20:41 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:20:41 user nova-compute[72894]:     </system>
Aug 16 20:20:41 user nova-compute[72894]:   </sysinfo>
Aug 16 20:20:41 user nova-compute[72894]:   <os>
Aug 16 20:20:41 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:20:41 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:20:41 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:20:41 user nova-compute[72894]:   </os>
Aug 16 20:20:41 user nova-compute[72894]:   <features>
Aug 16 20:20:41 user nova-compute[72894]:     <acpi/>
Aug 16 20:20:41 user nova-compute[72894]:     <apic/>
Aug 16 20:20:41 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:20:41 user nova-compute[72894]:   </features>
Aug 16 20:20:41 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:20:41 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:20:41 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:20:41 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:20:41 user nova-compute[72894]:   </clock>
Aug 16 20:20:41 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:20:41 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:20:41 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:20:41 user nova-compute[72894]:   </cpu>
Aug 16 20:20:41 user nova-compute[72894]:   <devices>
Aug 16 20:20:41 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:20:41 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:20:41 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk"/>
Aug 16 20:20:41 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:20:41 user nova-compute[72894]:     </disk>
Aug 16 20:20:41 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:20:41 user nova-compute[72894]:       <mac address="fa:16:3e:3d:fb:45"/>
Aug 16 20:20:41 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:20:41 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:20:41 user nova-compute[72894]:       <target dev="tap8a59c520-5b"/>
Aug 16 20:20:41 user nova-compute[72894]:     </interface>
Aug 16 20:20:41 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:20:41 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/console.log" append="off"/>
Aug 16 20:20:41 user nova-compute[72894]:     </serial>
Aug 16 20:20:41 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:20:41 user nova-compute[72894]:     <video>
Aug 16 20:20:41 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:20:41 user nova-compute[72894]:     </video>
Aug 16 20:20:41 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:20:41 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:20:41 user nova-compute[72894]:     </rng>
Aug 16 20:20:41 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:20:41 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:20:41 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:20:41 user nova-compute[72894]:     </memballoon>
Aug 16 20:20:41 user nova-compute[72894]:   </devices>
Aug 16 20:20:41 user nova-compute[72894]: </domain>
Aug 16 20:20:41 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33731133',display_name='tempest-VolumesNegativeTest-instance-33731133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33731133',id=42,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fc019b63604cc294c4899d7eee3e7b',ramdisk_id='',reservation_id='r-8hct0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-430496650',owner_user_name='tempest-VolumesNegativeTest-430496650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:20:39Z,user_data=None,user_id='595bc127800b4db694720926fe6da359',uuid=038a6f72-a311-4c28-84b1-119fce57baee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converting VIF {"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG os_vif [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a59c520-5b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a59c520-5b, col_values=(('external_ids', {'iface-id': '8a59c520-5b2d-49d3-a7b8-b556a593fa7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:fb:45', 'vm-uuid': '038a6f72-a311-4c28-84b1-119fce57baee'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:20:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Instance destroyed successfully.
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'resources' on Instance uuid 1421be15-19af-4c18-989f-dd13aa3042e7 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1303090262',display_name='tempest-TestStampPattern-server-1303090262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1303090262',id=39,image_ref='7f929eb8-b442-46f5-8669-45536dded29a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-d7d6akhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f78d339d-1c1d-44e4-94f3-d9287767ce61',image_min_disk='1',image_min_ram='0',image_owner_id='5bb802770440441ca765afcbca83440e',image_owner_project_name='tempest-TestStampPattern-1667960248',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1667960248-project-member',image_user_id='5ec5f4494fff47b2aef65898afa8afa0',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:17:50Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=1421be15-19af-4c18-989f-dd13aa3042e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "address": "fa:16:3e:e8:5a:d5", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee585fc-28", "ovs_interfaceid": "0ee585fc-2800-4171-a8f4-de40cb744eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG os_vif [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: INFO os_vif [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b')
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee585fc-28, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:41 user nova-compute[72894]: INFO os_vif [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5a:d5,bridge_name='br-int',has_traffic_filtering=True,id=0ee585fc-2800-4171-a8f4-de40cb744eb5,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee585fc-28')
Aug 16 20:20:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Deleting instance files /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7_del
Aug 16 20:20:41 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Deletion of /opt/stack/data/nova/instances/1421be15-19af-4c18-989f-dd13aa3042e7_del complete
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] No VIF found with MAC fa:16:3e:3d:fb:45, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:20:41 user nova-compute[72894]: INFO nova.compute.manager [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 20:20:41 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Updated VIF entry in instance network info cache for port 8a59c520-5b2d-49d3-a7b8-b556a593fa7d. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Updating instance_info_cache with network_info: [{"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f894f282-4dc3-4f2d-9b40-a7a3d05c4502 req-d4949779-33a3-4130-a782-8e6caf478bac service nova] Releasing lock "refresh_cache-038a6f72-a311-4c28-84b1-119fce57baee" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:42 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Took 0.51 seconds to deallocate network for instance.
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-49e988fa-f338-49a7-a9f3-8e1f63622c3c req-ab86179c-70b8-445a-9243-59e1d9eef62d service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-vif-deleted-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:42 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Deleted allocations for instance 1421be15-19af-4c18-989f-dd13aa3042e7
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-vif-unplugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] No waiting events found dispatching network-vif-unplugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:42 user nova-compute[72894]: WARNING nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received unexpected event network-vif-unplugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 for instance with vm_state deleted and task_state None.
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Acquiring lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] Lock "1421be15-19af-4c18-989f-dd13aa3042e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] No waiting events found dispatching network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:42 user nova-compute[72894]: WARNING nova.compute.manager [req-d2d77847-1573-4a90-93e9-68928fa980da req-d70b2642-8785-4aa4-9c5e-43828a1b6216 service nova] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Received unexpected event network-vif-plugged-0ee585fc-2800-4171-a8f4-de40cb744eb5 for instance with vm_state deleted and task_state None.
Aug 16 20:20:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f9601105-477b-4ca8-86b5-10743ada0288 tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "1421be15-19af-4c18-989f-dd13aa3042e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] No waiting events found dispatching network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:44 user nova-compute[72894]: WARNING nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received unexpected event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d for instance with vm_state building and task_state spawning.
Aug 16 20:20:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] No waiting events found dispatching network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:44 user nova-compute[72894]: WARNING nova.compute.manager [req-81252a24-e67b-4843-bb12-5f6537ed921d req-d17f4bc1-2d80-49af-8e13-4befe2a64f79 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received unexpected event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d for instance with vm_state building and task_state spawning.
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217245.026894, 038a6f72-a311-4c28-84b1-119fce57baee => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] VM Resumed (Lifecycle Event)
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Instance spawned successfully.
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217245.0286417, 038a6f72-a311-4c28-84b1-119fce57baee => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] VM Started (Lifecycle Event)
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 16 20:20:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:45 user nova-compute[72894]: INFO nova.compute.manager [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Took 6.74 seconds to build instance.
Aug 16 20:20:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d69af8c8-256e-40a3-a760-2278d3434a81 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.838s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:47 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217232.241167, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:47 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Stopped (Lifecycle Event)
Aug 16 20:20:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-676707a4-829e-435e-93ae-12a16f4d4d1d None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-676707a4-829e-435e-93ae-12a16f4d4d1d None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:48 user nova-compute[72894]: INFO nova.compute.manager [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Terminating instance
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-7e2d756c-c6da-4eb4-9b44-31415a0e6f82 req-c194c2c2-0b18-4e55-a160-165d4a2e15b1 service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-unplugged-05779040-3363-4917-a20c-c2971d311404 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:20:48 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Instance destroyed successfully.
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lazy-loading 'resources' on Instance uuid 60dd6c6f-825a-4367-a215-c3989d1db134 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1176160800',display_name='tempest-ServerRescueNegativeTestJSON-server-1176160800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1176160800',id=18,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14bb5629d37246269932266408249714',ramdisk_id='',reservation_id='r-1jnbdiq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142763307',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142763307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:10:15Z,user_data=None,user_id='be3a706becb041598d5a63714a389801',uuid=60dd6c6f-825a-4367-a215-c3989d1db134,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converting VIF {"id": "05779040-3363-4917-a20c-c2971d311404", "address": "fa:16:3e:65:ca:1e", "network": {"id": "d1b42444-aad5-4e47-9680-6f7578832116", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1162958920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14bb5629d37246269932266408249714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05779040-33", "ovs_interfaceid": "05779040-3363-4917-a20c-c2971d311404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG os_vif [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05779040-33, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:49 user nova-compute[72894]: INFO os_vif [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=05779040-3363-4917-a20c-c2971d311404,network=Network(d1b42444-aad5-4e47-9680-6f7578832116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05779040-33')
Aug 16 20:20:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Deleting instance files /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134_del
Aug 16 20:20:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Deletion of /opt/stack/data/nova/instances/60dd6c6f-825a-4367-a215-c3989d1db134_del complete
Aug 16 20:20:49 user nova-compute[72894]: INFO nova.compute.manager [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:20:49 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Took 0.55 seconds to deallocate network for instance.
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:50 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Deleted allocations for instance 60dd6c6f-825a-4367-a215-c3989d1db134
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3623f968-f094-483a-a08c-1d6702c8d11f tempest-ServerRescueNegativeTestJSON-2142763307 tempest-ServerRescueNegativeTestJSON-2142763307-project-member] Lock "60dd6c6f-825a-4367-a215-c3989d1db134" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] Acquiring lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] Lock "60dd6c6f-825a-4367-a215-c3989d1db134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] No waiting events found dispatching network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:20:50 user nova-compute[72894]: WARNING nova.compute.manager [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received unexpected event network-vif-plugged-05779040-3363-4917-a20c-c2971d311404 for instance with vm_state deleted and task_state None.
Aug 16 20:20:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-58023130-b564-4ac4-8abd-e6438191b9da req-ea536b72-1bcd-4c80-834a-5337d89fff6c service nova] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Received event network-vif-deleted-05779040-3363-4917-a20c-c2971d311404 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:20:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:20:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=24.146251678466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance f78d339d-1c1d-44e4-94f3-d9287767ce61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 997cca71-e41a-455e-a02b-854d7fad614b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 038a6f72-a311-4c28-84b1-119fce57baee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:20:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:20:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:20:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:20:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:20:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:20:56 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217241.4293742, 1421be15-19af-4c18-989f-dd13aa3042e7 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:20:56 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] VM Stopped (Lifecycle Event)
Aug 16 20:20:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-70b7d936-7342-45e2-84bd-d862f6eff9a1 None None] [instance: 1421be15-19af-4c18-989f-dd13aa3042e7] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:20:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:20:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:03 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217248.9352407, 60dd6c6f-825a-4367-a215-c3989d1db134 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:21:03 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] VM Stopped (Lifecycle Event)
Aug 16 20:21:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-93bd26af-b807-40e9-98c6-f042537aee2c None None] [instance: 60dd6c6f-825a-4367-a215-c3989d1db134] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-changed-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Refreshing instance network info cache due to event network-changed-e73a954c-f9ca-41cf-b016-c67301a63216. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] Acquiring lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] Acquired lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Refreshing network info cache for port e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updated VIF entry in instance network info cache for port e73a954c-f9ca-41cf-b016-c67301a63216. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG nova.network.neutron [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating instance_info_cache with network_info: [{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-adfd460f-dfbd-46f1-908f-61d598ee9109 req-d7fa77c2-3622-42db-9640-944238420f0a service nova] Releasing lock "refresh_cache-7d337a32-9e8d-49b4-a87c-46b4eb79b616" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:21:17 user nova-compute[72894]: INFO nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Rebuilding instance
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'pci_requests' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'resources' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'migration_context' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing instance network info cache due to event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72894) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:17 user nova-compute[72894]: INFO nova.compute.manager [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Detaching volume 2b4d1982-d23a-4fef-a3b6-618858ce1c49
Aug 16 20:21:17 user nova-compute[72894]: INFO nova.virt.block_device [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Attempting to driver detach volume 2b4d1982-d23a-4fef-a3b6-618858ce1c49 from mountpoint /dev/vdb
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Attempting to detach device vdb from instance 997cca71-e41a-455e-a02b-854d7fad614b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:21:17 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:21:17 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:21:17 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:21:17 user nova-compute[72894]:   <serial>2b4d1982-d23a-4fef-a3b6-618858ce1c49</serial>
Aug 16 20:21:17 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:21:17 user nova-compute[72894]: </disk>
Aug 16 20:21:17 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:21:17 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully detached device vdb from instance 997cca71-e41a-455e-a02b-854d7fad614b from the persistent domain config.
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 997cca71-e41a-455e-a02b-854d7fad614b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:21:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:21:17 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:21:17 user nova-compute[72894]:   <source dev="/dev/sdd"/>
Aug 16 20:21:17 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:21:17 user nova-compute[72894]:   <serial>2b4d1982-d23a-4fef-a3b6-618858ce1c49</serial>
Aug 16 20:21:17 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:21:17 user nova-compute[72894]: </disk>
Aug 16 20:21:17 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated VIF entry in instance network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-500e2f53-7ceb-4ec7-bfbe-408ab263f173 req-ee0e2741-cf42-46f1-8c9a-00f23f099871 service nova] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing instance network info cache due to event network-changed-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Refreshing network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217278.6745949, 997cca71-e41a-455e-a02b-854d7fad614b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:21:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully detached device vdb from instance 997cca71-e41a-455e-a02b-854d7fad614b from the live domain config.
Aug 16 20:21:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance destroyed successfully.
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IObaGyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:21:18 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance destroyed successfully.
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-759191279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9643c-84f5-46a0-a60e-cb5001d9efb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape73a954c-f9, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:18 user nova-compute[72894]: INFO os_vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9')
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:21:18 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ea6050-3ae2-490b-8756-ece7bd842ef9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:21:18 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:18 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 (non-flash)
Aug 16 20:21:18 user nova-compute[72894]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:18 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:18 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c694790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49'): ({'sdd'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Removing single pathed devices sdd {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated VIF entry in instance network info cache for port 07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd556c-9d61-4768-b45d-2f88cd1a5e19]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:18 user nova-compute[72894]: WARNING nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state active and task_state rebuilding.
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:18 user nova-compute[72894]: WARNING nova.compute.manager [req-b321a15f-1f4c-4795-a11a-d551b9eadcad req-77c99283-a367-4a5e-9c72-548e78ff1400 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state active and task_state rebuilding.
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8260f110-29d2-4e93-8b06-96044083906b]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Flushing IO for device /dev/sdd {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e3d37-7d2a-402a-b81e-2c4524b42003]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658777b-2cd2-4b97-a561-fe7e58fd61ef]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] SCSI volumes sdd have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79fbced-d230-4edd-a9c5-545cab124e05]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.185s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1cdd5e-eeaf-48bd-9c8e-d181891154ee]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260]
Aug 16 20:21:19 user nova-compute[72894]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49, portal: 172.16.0.220,3260] successful.
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4d1982-d23a-4fef-a3b6-618858ce1c49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4375546-50fb-4803-a368-f19c31dbfa7c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] <== disconnect_volume: return (448ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.394s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa62283-2888-4b59-b974-07e1661c8846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e95a2-a194-4a9a-874d-cb51ff5af845]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:19 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:19 user nova-compute[72894]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4ad53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f832d5-2a43-44e0-a189-f252a53cbe1e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67dd6aa-82a1-4a2a-9ff0-4759c529f92b]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480373b-2937-410d-bb03-d24a106f4370]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bba2597-d74d-492d-898b-722388a026d9]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7164dbec-882a-47c5-a365-0be53a15d5bf]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a55c46d-9ee8-463f-a08d-830871ed6e1f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]
Aug 16 20:21:19 user nova-compute[72894]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bacc14-637b-4ec4-a5a6-5f9249cab75d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== disconnect_volume: return (699ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:21:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deleting instance files /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616_del
Aug 16 20:21:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deletion of /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616_del complete
Aug 16 20:21:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616 could not be found.
Aug 16 20:21:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:21:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82cca58-de6d-4884-b1af-09c849289759]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c470e51c-ed64-43e9-9260-52cb7876dff8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990600d30>, {}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Disconnecting from: [] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== disconnect_volume: return (47ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'flavor' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-860ee2ee-570a-4b5a-aedb-a52932a2f6bb tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.193s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Preparing to wait for external event volume-reimaged-c5dd7596-366f-4136-a5a4-3741ae48b0d7 {{(pid=72894) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 20:21:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:33 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217278.682386, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:21:33 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Stopped (Lifecycle Event)
Aug 16 20:21:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-16f31701-2307-4c94-885e-794f4c5497ba None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:21:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-e5655261-c87e-4f1a-b0a9-dc661acabb0d req-a2bfbd5f-ba17-453f-b6e6-f75a2bf281da service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event volume-reimaged-c5dd7596-366f-4136-a5a4-3741ae48b0d7 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e5655261-c87e-4f1a-b0a9-dc661acabb0d req-a2bfbd5f-ba17-453f-b6e6-f75a2bf281da service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e5655261-c87e-4f1a-b0a9-dc661acabb0d req-a2bfbd5f-ba17-453f-b6e6-f75a2bf281da service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e5655261-c87e-4f1a-b0a9-dc661acabb0d req-a2bfbd5f-ba17-453f-b6e6-f75a2bf281da service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-e5655261-c87e-4f1a-b0a9-dc661acabb0d req-a2bfbd5f-ba17-453f-b6e6-f75a2bf281da service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Processing event volume-reimaged-c5dd7596-366f-4136-a5a4-3741ae48b0d7 {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 20:21:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:21:41 user nova-compute[72894]: INFO nova.virt.block_device [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Booting with volume c5dd7596-366f-4136-a5a4-3741ae48b0d7 at /dev/vda
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.utils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f698b7f-f578-49a6-98dd-6a3d42f67d1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec17a86-7aca-4ebd-bb90-07be689779e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6025c90-a2e4-4dfe-b068-2dd10a69836c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[719350ed-3ffa-4ea2-bb94-62078e45823a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:21:41 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:21:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566b641-8a53-47ce-b3f4-08a8b3328830]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG os_brick.utils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating existing volume attachment record: 049cdec7-4689-49cd-98c0-4079f8b05731 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:21:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing instance network info cache due to event network-changed-ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] Acquiring lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] Acquired lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Refreshing network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:48 user nova-compute[72894]: INFO nova.compute.manager [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Terminating instance
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-unplugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] No waiting events found dispatching network-vif-unplugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-29b7bbb3-49a0-4958-aa16-439d53cb5976 req-df194718-3310-475b-9c99-19f74451da78 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-unplugged-ab958e47-2e82-4ebc-a12a-566d5d43589b for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updated VIF entry in instance network info cache for port ab958e47-2e82-4ebc-a12a-566d5d43589b. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [{"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-a7183e64-f863-490c-91f6-979297c01485 req-846856fc-5b74-4160-aaeb-3b8e483bc167 service nova] Releasing lock "refresh_cache-f78d339d-1c1d-44e4-94f3-d9287767ce61" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:21:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Instance destroyed successfully.
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.objects.instance [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lazy-loading 'resources' on Instance uuid f78d339d-1c1d-44e4-94f3-d9287767ce61 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2061280835',display_name='tempest-TestStampPattern-server-2061280835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2061280835',id=34,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9+08CSIpBT8eDwPhZjtYvm2eCscPvM3MvohXCyJPYHWeoWRgJPVJME5eOxZTldhotu/Cti0hnuJgH1MyRBIB9XyEmdzUOMZ0SRJe4v4uEnnrW++vOZnP70RIozRUvLDw==',key_name='tempest-TestStampPattern-1669203899',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb802770440441ca765afcbca83440e',ramdisk_id='',reservation_id='r-zb4jcug1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1667960248',owner_user_name='tempest-TestStampPattern-1667960248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:17:38Z,user_data=None,user_id='5ec5f4494fff47b2aef65898afa8afa0',uuid=f78d339d-1c1d-44e4-94f3-d9287767ce61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converting VIF {"id": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "address": "fa:16:3e:ca:08:45", "network": {"id": "30f90641-b88c-466f-9ea9-ef61824d2220", "bridge": "br-int", "label": "tempest-TestStampPattern-582093108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb802770440441ca765afcbca83440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab958e47-2e", "ovs_interfaceid": "ab958e47-2e82-4ebc-a12a-566d5d43589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG os_vif [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab958e47-2e, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:49 user nova-compute[72894]: INFO os_vif [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:08:45,bridge_name='br-int',has_traffic_filtering=True,id=ab958e47-2e82-4ebc-a12a-566d5d43589b,network=Network(30f90641-b88c-466f-9ea9-ef61824d2220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab958e47-2e')
Aug 16 20:21:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Deleting instance files /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61_del
Aug 16 20:21:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Deletion of /opt/stack/data/nova/instances/f78d339d-1c1d-44e4-94f3-d9287767ce61_del complete
Aug 16 20:21:49 user nova-compute[72894]: INFO nova.compute.manager [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:49 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Took 0.56 seconds to deallocate network for instance.
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:50 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Deleted allocations for instance f78d339d-1c1d-44e4-94f3-d9287767ce61
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG nova.compute.manager [req-6e165826-181d-4118-b11e-61ed3274e569 req-c4c8fda8-94ca-4917-a1a7-ab2bdbb33aa2 service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-deleted-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-435339e6-5495-44b8-891d-50643f9ca96b tempest-TestStampPattern-1667960248 tempest-TestStampPattern-1667960248-project-member] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] Acquiring lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] Lock "f78d339d-1c1d-44e4-94f3-d9287767ce61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] No waiting events found dispatching network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:51 user nova-compute[72894]: WARNING nova.compute.manager [req-6b45f548-2829-44a1-9a0e-29c9effa9693 req-00bfaf51-b5d8-4e77-9afa-a3792c3ebb1a service nova] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Received unexpected event network-vif-plugged-ab958e47-2e82-4ebc-a12a-566d5d43589b for instance with vm_state deleted and task_state None.
Aug 16 20:21:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:21:51 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8377MB free_disk=24.22439956665039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 997cca71-e41a-455e-a02b-854d7fad614b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 038a6f72-a311-4c28-84b1-119fce57baee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:21:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:21:52 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Creating image(s)
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Did not create local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Ensure instance console log exists: /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start _get_guest_xml network_info=[{"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '049cdec7-4689-49cd-98c0-4079f8b05731', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d337a32-9e8d-49b4-a87c-46b4eb79b616', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5dd7596-366f-4136-a5a4-3741ae48b0d7', 'serial': 'c5dd7596-366f-4136-a5a4-3741ae48b0d7'}, 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:21:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 20:21:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:21:52 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:21:52 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:21:52 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49af07a-520f-419d-8087-a4cbba3efba6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:21:52 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6113564-2818-48fa-831a-0745abe355d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7] added
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad1e53-6d2d-4d13-9a54-c2cc4445e57a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4d4f9-fb42-4b36-a8d0-8e90d85bf7e3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSYzJeWV {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSYzJeWV" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd5c6d-9c8c-4204-bfa5-cf321c765fbe]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSYzJeWV'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ece9c-a2de-4e3e-8dd6-1dbe1313431f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87648927-cf9c-48b3-aeff-ea3d306f63f6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2f633-3b47-4912-918d-9e1e49264e14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]
Aug 16 20:21:52 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f80f70-91fc-4906-a8e0-66bc7aff6867]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a44e5-e6da-495d-8364-6e5e7550b306]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:52 user nova-compute[72894]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:21:52 user nova-compute[72894]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:21:52 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:21:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c8179-e9b5-4d60-a9e4-6b56b71a3dc5]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [{"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-997cca71-e41a-455e-a02b-854d7fad614b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:21:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23030653839646538', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653839646538', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-759191279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:21:54 user nova-compute[72894]:   <uuid>7d337a32-9e8d-49b4-a87c-46b4eb79b616</uuid>
Aug 16 20:21:54 user nova-compute[72894]:   <name>instance-00000029</name>
Aug 16 20:21:54 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:21:54 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:21:54 user nova-compute[72894]:   <metadata>
Aug 16 20:21:54 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:21:54 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:21:54 user nova-compute[72894]:       <nova:name>tempest-ServerActionsV293TestJSON-server-759191279</nova:name>
Aug 16 20:21:54 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:21:52</nova:creationTime>
Aug 16 20:21:54 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:21:54 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:21:54 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:21:54 user nova-compute[72894]:       <nova:owner>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:user uuid="18c762f5c7c049b5a6b765b1345248c3">tempest-ServerActionsV293TestJSON-870577737-project-member</nova:user>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:project uuid="b368143e912d44a1adb66a8ae084dcea">tempest-ServerActionsV293TestJSON-870577737</nova:project>
Aug 16 20:21:54 user nova-compute[72894]:       </nova:owner>
Aug 16 20:21:54 user nova-compute[72894]:       <nova:ports>
Aug 16 20:21:54 user nova-compute[72894]:         <nova:port uuid="e73a954c-f9ca-41cf-b016-c67301a63216">
Aug 16 20:21:54 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 20:21:54 user nova-compute[72894]:         </nova:port>
Aug 16 20:21:54 user nova-compute[72894]:       </nova:ports>
Aug 16 20:21:54 user nova-compute[72894]:     </nova:instance>
Aug 16 20:21:54 user nova-compute[72894]:   </metadata>
Aug 16 20:21:54 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:21:54 user nova-compute[72894]:     <system>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="serial">7d337a32-9e8d-49b4-a87c-46b4eb79b616</entry>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="uuid">7d337a32-9e8d-49b4-a87c-46b4eb79b616</entry>
Aug 16 20:21:54 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:21:54 user nova-compute[72894]:     </system>
Aug 16 20:21:54 user nova-compute[72894]:   </sysinfo>
Aug 16 20:21:54 user nova-compute[72894]:   <os>
Aug 16 20:21:54 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:21:54 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:21:54 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:21:54 user nova-compute[72894]:   </os>
Aug 16 20:21:54 user nova-compute[72894]:   <features>
Aug 16 20:21:54 user nova-compute[72894]:     <acpi/>
Aug 16 20:21:54 user nova-compute[72894]:     <apic/>
Aug 16 20:21:54 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:21:54 user nova-compute[72894]:   </features>
Aug 16 20:21:54 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:21:54 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:21:54 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:21:54 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:21:54 user nova-compute[72894]:   </clock>
Aug 16 20:21:54 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:21:54 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:21:54 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:21:54 user nova-compute[72894]:   </cpu>
Aug 16 20:21:54 user nova-compute[72894]:   <devices>
Aug 16 20:21:54 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:21:54 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:21:54 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:21:54 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:21:54 user nova-compute[72894]:       <serial>c5dd7596-366f-4136-a5a4-3741ae48b0d7</serial>
Aug 16 20:21:54 user nova-compute[72894]:     </disk>
Aug 16 20:21:54 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:21:54 user nova-compute[72894]:       <mac address="fa:16:3e:b4:1b:85"/>
Aug 16 20:21:54 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:21:54 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:21:54 user nova-compute[72894]:       <target dev="tape73a954c-f9"/>
Aug 16 20:21:54 user nova-compute[72894]:     </interface>
Aug 16 20:21:54 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:21:54 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616/console.log" append="off"/>
Aug 16 20:21:54 user nova-compute[72894]:     </serial>
Aug 16 20:21:54 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:21:54 user nova-compute[72894]:     <video>
Aug 16 20:21:54 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:21:54 user nova-compute[72894]:     </video>
Aug 16 20:21:54 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:21:54 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:21:54 user nova-compute[72894]:     </rng>
Aug 16 20:21:54 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:21:54 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:21:54 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:21:54 user nova-compute[72894]:     </memballoon>
Aug 16 20:21:54 user nova-compute[72894]:   </devices>
Aug 16 20:21:54 user nova-compute[72894]: </domain>
Aug 16 20:21:54 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-759191279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG os_vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape73a954c-f9, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape73a954c-f9, col_values=(('external_ids', {'iface-id': 'e73a954c-f9ca-41cf-b016-c67301a63216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:1b:85', 'vm-uuid': '7d337a32-9e8d-49b4-a87c-46b4eb79b616'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:54 user nova-compute[72894]: INFO os_vif [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9')
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] No VIF found with MAC fa:16:3e:b4:1b:85, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:21:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:55 user nova-compute[72894]: WARNING nova.compute.manager [req-51de67fe-b547-4146-a5a2-ff65939811f6 req-aa0ae4a2-9479-4e91-93b1-a135fb9afdb6 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 20:21:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:21:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217317.6393838, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:21:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Resumed (Lifecycle Event)
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:21:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance spawned successfully.
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:21:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217317.64443, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:21:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Started (Lifecycle Event)
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:21:57 user nova-compute[72894]: WARNING nova.compute.manager [req-083fa940-94a6-4e3e-8792-0e4c694690ec req-5d9acb25-5bba-45ec-9f3b-4599aa3a1e5d service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:21:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72894) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 20:21:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e5655261-c87e-4f1a-b0a9-dc661acabb0d tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:21:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:21:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:04 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217309.0856094, f78d339d-1c1d-44e4-94f3-d9287767ce61 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:22:04 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] VM Stopped (Lifecycle Event)
Aug 16 20:22:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-39c682f5-7c78-418f-b451-50103395ea24 None None] [instance: f78d339d-1c1d-44e4-94f3-d9287767ce61] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:15 user nova-compute[72894]: INFO nova.compute.manager [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Terminating instance
Aug 16 20:22:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-3854b511-9a6c-4c61-84ec-beb6b102b241 req-d4eb3528-432a-4a85-80a9-f42188881994 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-unplugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:22:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Instance destroyed successfully.
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lazy-loading 'resources' on Instance uuid 997cca71-e41a-455e-a02b-854d7fad614b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1712131699',display_name='tempest-TestMinimumBasicScenario-server-1712131699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1712131699',id=37,image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUjYbTstpwZ5GEM+zUbxVUJCqd+EL/f2YxiUzHLXa5frYKGrvoKABIU7p04bTH0Veqa7dZfvHVodhzN3GGUWiiTDmxbvKFuYFNFHrd23tT33h4/pUFJjXatHIwlR+HwOA==',key_name='tempest-TestMinimumBasicScenario-2103614112',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d28ea40d38684e26a5abd0292d031801',ramdisk_id='',reservation_id='r-qlgzqjdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4e708b0a-3afd-43cf-b2a3-83c75e9d37d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-872391646',owner_user_name='tempest-TestMinimumBasicScenario-872391646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:19:31Z,user_data=None,user_id='1b2c321a6776409a9dea0f817f58e07a',uuid=997cca71-e41a-455e-a02b-854d7fad614b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converting VIF {"id": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "address": "fa:16:3e:e3:e7:c5", "network": {"id": "13e732e9-8b67-43ca-bdd1-a964cb39c266", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-29949365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d28ea40d38684e26a5abd0292d031801", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07cfa1ee-e8", "ovs_interfaceid": "07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG os_vif [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07cfa1ee-e8, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:16 user nova-compute[72894]: INFO os_vif [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e7:c5,bridge_name='br-int',has_traffic_filtering=True,id=07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb,network=Network(13e732e9-8b67-43ca-bdd1-a964cb39c266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07cfa1ee-e8')
Aug 16 20:22:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Deleting instance files /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b_del
Aug 16 20:22:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Deletion of /opt/stack/data/nova/instances/997cca71-e41a-455e-a02b-854d7fad614b_del complete
Aug 16 20:22:16 user nova-compute[72894]: INFO nova.compute.manager [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 20:22:16 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:22:16 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:22:17 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Took 0.46 seconds to deallocate network for instance.
Aug 16 20:22:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-df24f4dd-83ad-4f5d-a14d-95dd00d7b3d1 req-7d554ce8-2b52-4ba0-a806-c593fc44f461 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-deleted-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:22:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:17 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Deleted allocations for instance 997cca71-e41a-455e-a02b-854d7fad614b
Aug 16 20:22:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-ff3a370b-4a27-480a-ba64-c581603c980f tempest-TestMinimumBasicScenario-872391646 tempest-TestMinimumBasicScenario-872391646-project-member] Lock "997cca71-e41a-455e-a02b-854d7fad614b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] Acquiring lock "997cca71-e41a-455e-a02b-854d7fad614b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] Lock "997cca71-e41a-455e-a02b-854d7fad614b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] No waiting events found dispatching network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:18 user nova-compute[72894]: WARNING nova.compute.manager [req-3a59a51d-1fd2-4032-82e1-2d6a7f4bf078 req-eb004e86-c653-43cc-9a3e-504192e0cec5 service nova] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Received unexpected event network-vif-plugged-07cfa1ee-e824-4ff4-bb60-efe7bdc35ccb for instance with vm_state deleted and task_state None.
Aug 16 20:22:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'info_cache' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:22:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance destroyed successfully.
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'resources' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26af5b25-77, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:22 user nova-compute[72894]: INFO os_vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:22:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:22:22 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26dc877-71b0-4d64-8fca-48181ae94c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ee773e-d422-46cc-ab95-c4e35c7406fd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:22:22 user nova-compute[72894]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:22 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:22:22 user nova-compute[72894]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:22 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c675bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b2dee-fa57-4ef4-b5ff-800c58f31d81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[534db206-724e-4539-808f-71a35f7f89b0]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9d130d-0aa0-4612-9c0d-f27b33a71240]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e30cee2-293a-4548-9491-b8ec0ea5fe82]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b73a5f6-f8ce-479d-bea0-748374c191ee]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a0cc5-be9a-48af-b07f-d9b9f20c8b2b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]
Aug 16 20:22:23 user nova-compute[72894]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[867db84d-fe6f-4bd9-a784-340fc97023fd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== disconnect_volume: return (295ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start _get_guest_xml network_info=[{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '9a98cf3c-5540-4a5c-834c-2e2407e7830d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '185cb39d-bad2-4e91-9cf3-a1eaba68a0b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae', 'serial': 'c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'numa_topology' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:23 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:22:23 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:22:23 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:22:23 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:22:23 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b283f7-e881-4c14-ae4c-c1f119a3525e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:22:23 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c1c2c-7e45-4b77-8ec9-e6e88ce8d8ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae] added
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e10bcd-93fb-443b-a80e-81c131e60a65]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f778f9f-b4f6-49a9-bb90-8d7317a89492]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJKdOrbL {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJKdOrbL" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d236cc2-9337-475e-a577-13e6136b97e4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJKdOrbL'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6e82a-5ee0-400b-bbc3-67815a1b0f35]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ca4f0-9637-4c09-8e51-1d12d66e3e58]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2249bf31-ad2e-4527-81b5-079cce2e8b8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]
Aug 16 20:22:23 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d492a31-135e-4a4d-965a-cec3abb43af5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[395bede7-6409-4098-905f-d39deac69911]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:23 user nova-compute[72894]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:22:23 user nova-compute[72894]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:22:23 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5156bf0-0e3b-49d9-89d8-e7c0c5147c85]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:22:23 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26561393736323231', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561393736323231', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'pci_devices' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:22:24 user nova-compute[72894]:   <uuid>185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</uuid>
Aug 16 20:22:24 user nova-compute[72894]:   <name>instance-00000028</name>
Aug 16 20:22:24 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:22:24 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:22:24 user nova-compute[72894]:   <metadata>
Aug 16 20:22:24 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:22:24 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeTestJSON-server-2064230726</nova:name>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:22:23</nova:creationTime>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:22:24 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:22:24 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:owner>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:user uuid="181c019980b642c68023ff7283869af1">tempest-AttachVolumeTestJSON-1942038190-project-member</nova:user>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:project uuid="c04c911a91a94f6b843ce6d3419e0be1">tempest-AttachVolumeTestJSON-1942038190</nova:project>
Aug 16 20:22:24 user nova-compute[72894]:       </nova:owner>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:22:24 user nova-compute[72894]:       <nova:ports>
Aug 16 20:22:24 user nova-compute[72894]:         <nova:port uuid="26af5b25-77e0-492e-9991-d35c6d83b0a5">
Aug 16 20:22:24 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 20:22:24 user nova-compute[72894]:         </nova:port>
Aug 16 20:22:24 user nova-compute[72894]:       </nova:ports>
Aug 16 20:22:24 user nova-compute[72894]:     </nova:instance>
Aug 16 20:22:24 user nova-compute[72894]:   </metadata>
Aug 16 20:22:24 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:22:24 user nova-compute[72894]:     <system>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="serial">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="uuid">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:22:24 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:22:24 user nova-compute[72894]:     </system>
Aug 16 20:22:24 user nova-compute[72894]:   </sysinfo>
Aug 16 20:22:24 user nova-compute[72894]:   <os>
Aug 16 20:22:24 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:22:24 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:22:24 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:22:24 user nova-compute[72894]:   </os>
Aug 16 20:22:24 user nova-compute[72894]:   <features>
Aug 16 20:22:24 user nova-compute[72894]:     <acpi/>
Aug 16 20:22:24 user nova-compute[72894]:     <apic/>
Aug 16 20:22:24 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:22:24 user nova-compute[72894]:   </features>
Aug 16 20:22:24 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:22:24 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:22:24 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:22:24 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:22:24 user nova-compute[72894]:   </clock>
Aug 16 20:22:24 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:22:24 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:22:24 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:22:24 user nova-compute[72894]:   </cpu>
Aug 16 20:22:24 user nova-compute[72894]:   <devices>
Aug 16 20:22:24 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:22:24 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:22:24 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk"/>
Aug 16 20:22:24 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:22:24 user nova-compute[72894]:     </disk>
Aug 16 20:22:24 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:22:24 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:22:24 user nova-compute[72894]:       <source dev="/dev/sdc"/>
Aug 16 20:22:24 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:22:24 user nova-compute[72894]:       <serial>c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae</serial>
Aug 16 20:22:24 user nova-compute[72894]:     </disk>
Aug 16 20:22:24 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:22:24 user nova-compute[72894]:       <mac address="fa:16:3e:51:67:92"/>
Aug 16 20:22:24 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:22:24 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:22:24 user nova-compute[72894]:       <target dev="tap26af5b25-77"/>
Aug 16 20:22:24 user nova-compute[72894]:     </interface>
Aug 16 20:22:24 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:22:24 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/console.log" append="off"/>
Aug 16 20:22:24 user nova-compute[72894]:     </serial>
Aug 16 20:22:24 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:22:24 user nova-compute[72894]:     <video>
Aug 16 20:22:24 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:22:24 user nova-compute[72894]:     </video>
Aug 16 20:22:24 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:22:24 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:22:24 user nova-compute[72894]:     </rng>
Aug 16 20:22:24 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:22:24 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:22:24 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:22:24 user nova-compute[72894]:     </memballoon>
Aug 16 20:22:24 user nova-compute[72894]:   </devices>
Aug 16 20:22:24 user nova-compute[72894]: </domain>
Aug 16 20:22:24 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Cannot resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'migration_context' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG os_vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26af5b25-77, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26af5b25-77, col_values=(('external_ids', {'iface-id': '26af5b25-77e0-492e-9991-d35c6d83b0a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:67:92', 'vm-uuid': '185cb39d-bad2-4e91-9cf3-a1eaba68a0b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:25 user nova-compute[72894]: INFO os_vif [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:22:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:27 user nova-compute[72894]: WARNING nova.compute.manager [req-916f02ea-b4c7-452e-87d7-6dfd0a4a1d84 req-5dfc38e7-eb56-4901-b424-d295d84e8df0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state powering-on.
Aug 16 20:22:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:28 user nova-compute[72894]: INFO nova.compute.manager [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Terminating instance
Aug 16 20:22:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-unplugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] No waiting events found dispatching network-vif-unplugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e271816e-3735-4fad-ae92-aa3ed81d7ceb req-7ce56fc6-ec69-44f9-b4e8-ff510b19b4c8 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-unplugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Instance destroyed successfully.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lazy-loading 'resources' on Instance uuid 038a6f72-a311-4c28-84b1-119fce57baee {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33731133',display_name='tempest-VolumesNegativeTest-instance-33731133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33731133',id=42,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fc019b63604cc294c4899d7eee3e7b',ramdisk_id='',reservation_id='r-8hct0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-430496650',owner_user_name='tempest-VolumesNegativeTest-430496650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:20:45Z,user_data=None,user_id='595bc127800b4db694720926fe6da359',uuid=038a6f72-a311-4c28-84b1-119fce57baee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converting VIF {"id": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "address": "fa:16:3e:3d:fb:45", "network": {"id": "c828b4ec-68c2-4e6a-8235-5b6a149eca1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6bf837b97d74a57ac5b1ac44c5019d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a59c520-5b", "ovs_interfaceid": "8a59c520-5b2d-49d3-a7b8-b556a593fa7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG os_vif [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a59c520-5b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:29 user nova-compute[72894]: INFO os_vif [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fb:45,bridge_name='br-int',has_traffic_filtering=True,id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d,network=Network(c828b4ec-68c2-4e6a-8235-5b6a149eca1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a59c520-5b')
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Deleting instance files /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee_del
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Deletion of /opt/stack/data/nova/instances/038a6f72-a311-4c28-84b1-119fce57baee_del complete
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217349.1685417, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Resumed (Lifecycle Event)
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance rebooted successfully.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bb95501e-1168-441d-8a88-4b125809fdac tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217349.1696532, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Started (Lifecycle Event)
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:29 user nova-compute[72894]: WARNING nova.compute.manager [req-41f96724-ac4f-40d9-8710-2fd019711333 req-4f201d8c-3a30-4b93-aaa6-1621b33fca0c service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state powering-on.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-b2a07a9a-824a-4d47-812b-e00e6b51078a req-5896d9f8-24d5-4731-9966-fd6b95c37d72 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-deleted-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [req-b2a07a9a-824a-4d47-812b-e00e6b51078a req-5896d9f8-24d5-4731-9966-fd6b95c37d72 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Neutron deleted interface 8a59c520-5b2d-49d3-a7b8-b556a593fa7d; detaching it from the instance and deleting it from the info cache
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-b2a07a9a-824a-4d47-812b-e00e6b51078a req-5896d9f8-24d5-4731-9966-fd6b95c37d72 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:22:29 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Took 0.62 seconds to deallocate network for instance.
Aug 16 20:22:29 user nova-compute[72894]: DEBUG nova.compute.manager [req-b2a07a9a-824a-4d47-812b-e00e6b51078a req-5896d9f8-24d5-4731-9966-fd6b95c37d72 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Detach interface failed, port_id=8a59c520-5b2d-49d3-a7b8-b556a593fa7d, reason: Instance 038a6f72-a311-4c28-84b1-119fce57baee could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:30 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Deleted allocations for instance 038a6f72-a311-4c28-84b1-119fce57baee
Aug 16 20:22:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-afe03a0a-cbe0-4e68-ae81-49a5ad522879 tempest-VolumesNegativeTest-430496650 tempest-VolumesNegativeTest-430496650-project-member] Lock "038a6f72-a311-4c28-84b1-119fce57baee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] Acquiring lock "038a6f72-a311-4c28-84b1-119fce57baee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] Lock "038a6f72-a311-4c28-84b1-119fce57baee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] No waiting events found dispatching network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:22:30 user nova-compute[72894]: WARNING nova.compute.manager [req-5b34c57f-8769-439f-b6d9-c4f47e7da28a req-37cfd1e0-5a4b-450b-8ff9-35354248c164 service nova] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Received unexpected event network-vif-plugged-8a59c520-5b2d-49d3-a7b8-b556a593fa7d for instance with vm_state deleted and task_state None.
Aug 16 20:22:31 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217336.6004636, 997cca71-e41a-455e-a02b-854d7fad614b => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:22:31 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] VM Stopped (Lifecycle Event)
Aug 16 20:22:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-2b659ad1-94a5-4f47-a6a9-11bcfa63e055 None None] [instance: 997cca71-e41a-455e-a02b-854d7fad614b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217349.0936103, 038a6f72-a311-4c28-84b1-119fce57baee => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:22:44 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] VM Stopped (Lifecycle Event)
Aug 16 20:22:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-782f7eab-416a-4ba4-9a1b-eba4b96ad100 None None] [instance: 038a6f72-a311-4c28-84b1-119fce57baee] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:22:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:22:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=24.26816177368164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:22:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:22:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:22:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:22:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:22:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:22:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:22:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:22:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:22:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:09 user nova-compute[72894]: INFO nova.compute.manager [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Terminating instance
Aug 16 20:23:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:23:09 user nova-compute[72894]: DEBUG nova.compute.manager [req-9eb8d429-f3d9-4d63-98e1-91b603266e04 req-8131b55a-602c-43f0-a236-060cff780fff service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-unplugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:23:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Instance destroyed successfully.
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lazy-loading 'resources' on Instance uuid 7d337a32-9e8d-49b4-a87c-46b4eb79b616 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T20:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-759191279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-944612676',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp+fi37bcXzRvetP68roPo6C+BJJ6rTCfadvOJ6UytnGa7OGzFaic1SdcWF5+TFu7eSpvtwiBGd4mr2rtn7rPnqcN93PIDhn4eiFwgUcMjswu0SxZV83gXfEfmFeQWT2Q==',key_name='tempest-keypair-640359073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:21:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b368143e912d44a1adb66a8ae084dcea',ramdisk_id='',reservation_id='r-2ed2rwmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-870577737',owner_user_name='tempest-ServerActionsV293TestJSON-870577737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c762f5c7c049b5a6b765b1345248c3',uuid=7d337a32-9e8d-49b4-a87c-46b4eb79b616,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converting VIF {"id": "e73a954c-f9ca-41cf-b016-c67301a63216", "address": "fa:16:3e:b4:1b:85", "network": {"id": "1befd8b1-4bed-47ff-ae5e-35782f960b40", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-587047711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b368143e912d44a1adb66a8ae084dcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73a954c-f9", "ovs_interfaceid": "e73a954c-f9ca-41cf-b016-c67301a63216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_vif [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape73a954c-f9, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:10 user nova-compute[72894]: INFO os_vif [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:85,bridge_name='br-int',has_traffic_filtering=True,id=e73a954c-f9ca-41cf-b016-c67301a63216,network=Network(1befd8b1-4bed-47ff-ae5e-35782f960b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73a954c-f9')
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSYzJeWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:23:10 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6cd05b-2b95-4074-b70e-8a7f2ff89dc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4a8a7-c383-4db7-88b8-c1555cf1c4b7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:23:10 user nova-compute[72894]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:23:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 (non-flash)
Aug 16 20:23:10 user nova-compute[72894]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:23:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79906364d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dbd7ef-bc4e-4c56-a549-3d3adaccc4b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aeea78-af24-415d-bcba-621d4ff4a859]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cc51a-5bf2-4b8b-a718-d344bfe154fd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a8516-daa2-43aa-8e67-9902ec601214]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO14bd3cc2-00e89de87960cfea', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_14bd3cc2', '/dev/disk/by-id/scsi-23030653839646538') {{(pid=83840) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3fc08-33bb-4df4-a121-875d5634e069]: (4, None) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfe4a32-fbc3-4902-b7d3-85ec0f136790]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[77751fdd-2e1b-4c43-ad4d-393e53fc5782]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260]
Aug 16 20:23:10 user nova-compute[72894]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7, portal: 172.16.0.220,3260] successful.
Aug 16 20:23:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5dd7596-366f-4136-a5a4-3741ae48b0d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14051f-efaf-4c7c-8d2d-6fcfc0568999]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] <== disconnect_volume: return (292ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:23:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deleting instance files /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616_del
Aug 16 20:23:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deletion of /opt/stack/data/nova/instances/7d337a32-9e8d-49b4-a87c-46b4eb79b616_del complete
Aug 16 20:23:10 user nova-compute[72894]: INFO nova.compute.manager [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 20:23:10 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:23:10 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:23:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:23:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] Acquiring lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] No waiting events found dispatching network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:23:12 user nova-compute[72894]: WARNING nova.compute.manager [req-93c908d1-f942-4ae2-90d9-6e8e08847312 req-e5b8ccf1-6140-4025-ad90-3d6237e8b760 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received unexpected event network-vif-plugged-e73a954c-f9ca-41cf-b016-c67301a63216 for instance with vm_state active and task_state deleting.
Aug 16 20:23:12 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:23:12 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Took 1.54 seconds to deallocate network for instance.
Aug 16 20:23:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-de6ed91a-28c2-4e46-bfce-c033a91ca071 req-5057de7c-990a-4317-be25-75f1ac1172b8 service nova] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Received event network-vif-deleted-e73a954c-f9ca-41cf-b016-c67301a63216 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:23:13 user nova-compute[72894]: INFO nova.compute.manager [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 20:23:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Deleting volume: c5dd7596-366f-4136-a5a4-3741ae48b0d7 {{(pid=72894) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:13 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Deleted allocations for instance 7d337a32-9e8d-49b4-a87c-46b4eb79b616
Aug 16 20:23:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5d98e65e-ba7c-4c35-aa80-8a0cb4ed38fd tempest-ServerActionsV293TestJSON-870577737 tempest-ServerActionsV293TestJSON-870577737-project-member] Lock "7d337a32-9e8d-49b4-a87c-46b4eb79b616" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217390.3285553, 7d337a32-9e8d-49b4-a87c-46b4eb79b616 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:23:25 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] VM Stopped (Lifecycle Event)
Aug 16 20:23:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f824faba-e1fe-4b32-bd59-cfb0e663411b None None] [instance: 7d337a32-9e8d-49b4-a87c-46b4eb79b616] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:23:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:23:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:23:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:23:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:23:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:23:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:23:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=24.296459197998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:23:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:23:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:23:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:23:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:23:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:24:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:13 user nova-compute[72894]: INFO nova.compute.manager [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Detaching volume c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae
Aug 16 20:24:13 user nova-compute[72894]: INFO nova.virt.block_device [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Attempting to driver detach volume c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae from mountpoint /dev/vdb
Aug 16 20:24:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Attempting to detach device vdb from instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:24:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:24:13 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:24:13 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:24:13 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:24:13 user nova-compute[72894]:   <serial>c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae</serial>
Aug 16 20:24:13 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:24:13 user nova-compute[72894]: </disk>
Aug 16 20:24:13 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:24:13 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdb from instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 from the persistent domain config.
Aug 16 20:24:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:24:13 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:24:13 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:24:13 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:24:13 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:24:13 user nova-compute[72894]:   <serial>c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae</serial>
Aug 16 20:24:13 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 20:24:13 user nova-compute[72894]: </disk>
Aug 16 20:24:13 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217454.245491, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:24:14 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdb from instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 from the live domain config.
Aug 16 20:24:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJKdOrbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:24:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a0eb0-18ee-49b4-ac24-4589ba895c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd66d1-9cff-4a0c-9c8a-fdc223bdfc61]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:24:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae (non-flash)
Aug 16 20:24:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c4ebd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10ac479-0407-4a4f-b321-5592a655a5d7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb8effc-58fa-45b9-b8ac-f5d278e9d4e6]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f958f97e-7f4d-4b46-b1fa-4d9ad38f0081]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590c210-1c8d-414f-8018-906165a7a6e6]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c82160-63bf-4ac8-a2a5-818086a0b1e5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0433c3f-cec7-4fdb-9256-364240aafe87]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260]
Aug 16 20:24:14 user nova-compute[72894]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae, portal: 172.16.0.220,3260] successful.
Aug 16 20:24:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404a9ac-ae8b-42bd-83c1-bd24a1fe3bae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173d029-3523-419f-9843-2400dc62f57f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== disconnect_volume: return (276ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:24:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:24:15 user nova-compute[72894]: INFO nova.compute.claims [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Claim successful on node user
Aug 16 20:24:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-83b2bcea-e103-47b8-bcc4-4eed3f4d77ab tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.906s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:24:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.policy [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86770bea7ddc440b8c1a3e81adb24cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c093167d32ce4486a1da4f1688d2a5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:24:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Creating image(s)
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72894) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.214s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk 1073741824" returned: 0 in 0.056s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.compute.manager [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:24:16 user nova-compute[72894]: WARNING nova.compute.manager [req-c720ed00-6876-495a-a8a5-ebe3276f2b5a req-c0c95434-fb81-418f-bc3a-4dfe6845040d service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state active and task_state powering-off.
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Successfully created port: fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Cannot resize image /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'migration_context' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Ensure instance console log exists: /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance destroyed successfully.
Aug 16 20:24:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f933883b-60de-4eeb-9811-486666cd7298 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Successfully updated port: fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.compute.manager [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing instance network info cache due to event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance network_info: |[{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.neutron [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start _get_guest_xml network_info=[{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:24:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:24:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977989885',display_name='tempest-ServerStableDeviceRescueTest-server-1977989885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977989885',id=43,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZMr6pNSznnDGIGmSFjzQZdvoa9cDVOWHRhlu/lkgPaqaeYwXZXThOp7cdgYGgL0TXx/5TgqEcfpAmopBN+ErE2TUrvUu4m1trVZfbCJZOxh+T0wDBaPuKqvep4Vr+Rw==',key_name='tempest-keypair-54417522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c093167d32ce4486a1da4f1688d2a5b8',ramdisk_id='',reservation_id='r-shud9vcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-911931366',owner_user_name='tempest-ServerStableDeviceRescueTest-911931366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86770bea7ddc440b8c1a3e81adb24cc4',uuid=4c4aa7fe-9139-42de-8005-58da4eb1f132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converting VIF {"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:24:17 user nova-compute[72894]:   <uuid>4c4aa7fe-9139-42de-8005-58da4eb1f132</uuid>
Aug 16 20:24:17 user nova-compute[72894]:   <name>instance-0000002b</name>
Aug 16 20:24:17 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:24:17 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:24:17 user nova-compute[72894]:   <metadata>
Aug 16 20:24:17 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:24:17 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1977989885</nova:name>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:24:17</nova:creationTime>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:24:17 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:24:17 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:owner>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:user uuid="86770bea7ddc440b8c1a3e81adb24cc4">tempest-ServerStableDeviceRescueTest-911931366-project-member</nova:user>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:project uuid="c093167d32ce4486a1da4f1688d2a5b8">tempest-ServerStableDeviceRescueTest-911931366</nova:project>
Aug 16 20:24:17 user nova-compute[72894]:       </nova:owner>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:24:17 user nova-compute[72894]:       <nova:ports>
Aug 16 20:24:17 user nova-compute[72894]:         <nova:port uuid="fcc3370c-0323-4582-b412-16b172e60a4c">
Aug 16 20:24:17 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 20:24:17 user nova-compute[72894]:         </nova:port>
Aug 16 20:24:17 user nova-compute[72894]:       </nova:ports>
Aug 16 20:24:17 user nova-compute[72894]:     </nova:instance>
Aug 16 20:24:17 user nova-compute[72894]:   </metadata>
Aug 16 20:24:17 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:24:17 user nova-compute[72894]:     <system>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="serial">4c4aa7fe-9139-42de-8005-58da4eb1f132</entry>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="uuid">4c4aa7fe-9139-42de-8005-58da4eb1f132</entry>
Aug 16 20:24:17 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:24:17 user nova-compute[72894]:     </system>
Aug 16 20:24:17 user nova-compute[72894]:   </sysinfo>
Aug 16 20:24:17 user nova-compute[72894]:   <os>
Aug 16 20:24:17 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:24:17 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:24:17 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:24:17 user nova-compute[72894]:   </os>
Aug 16 20:24:17 user nova-compute[72894]:   <features>
Aug 16 20:24:17 user nova-compute[72894]:     <acpi/>
Aug 16 20:24:17 user nova-compute[72894]:     <apic/>
Aug 16 20:24:17 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:24:17 user nova-compute[72894]:   </features>
Aug 16 20:24:17 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:24:17 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:24:17 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:24:17 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:24:17 user nova-compute[72894]:   </clock>
Aug 16 20:24:17 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:24:17 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:24:17 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:24:17 user nova-compute[72894]:   </cpu>
Aug 16 20:24:17 user nova-compute[72894]:   <devices>
Aug 16 20:24:17 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:24:17 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:24:17 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk"/>
Aug 16 20:24:17 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:24:17 user nova-compute[72894]:     </disk>
Aug 16 20:24:17 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:24:17 user nova-compute[72894]:       <mac address="fa:16:3e:51:75:61"/>
Aug 16 20:24:17 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:24:17 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:24:17 user nova-compute[72894]:       <target dev="tapfcc3370c-03"/>
Aug 16 20:24:17 user nova-compute[72894]:     </interface>
Aug 16 20:24:17 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:24:17 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/console.log" append="off"/>
Aug 16 20:24:17 user nova-compute[72894]:     </serial>
Aug 16 20:24:17 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:24:17 user nova-compute[72894]:     <video>
Aug 16 20:24:17 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:24:17 user nova-compute[72894]:     </video>
Aug 16 20:24:17 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:24:17 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:24:17 user nova-compute[72894]:     </rng>
Aug 16 20:24:17 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:24:17 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:24:17 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:24:17 user nova-compute[72894]:     </memballoon>
Aug 16 20:24:17 user nova-compute[72894]:   </devices>
Aug 16 20:24:17 user nova-compute[72894]: </domain>
Aug 16 20:24:17 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977989885',display_name='tempest-ServerStableDeviceRescueTest-server-1977989885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977989885',id=43,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZMr6pNSznnDGIGmSFjzQZdvoa9cDVOWHRhlu/lkgPaqaeYwXZXThOp7cdgYGgL0TXx/5TgqEcfpAmopBN+ErE2TUrvUu4m1trVZfbCJZOxh+T0wDBaPuKqvep4Vr+Rw==',key_name='tempest-keypair-54417522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c093167d32ce4486a1da4f1688d2a5b8',ramdisk_id='',reservation_id='r-shud9vcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-911931366',owner_user_name='tempest-ServerStableDeviceRescueTest-911931366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86770bea7ddc440b8c1a3e81adb24cc4',uuid=4c4aa7fe-9139-42de-8005-58da4eb1f132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converting VIF {"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG os_vif [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcc3370c-03, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcc3370c-03, col_values=(('external_ids', {'iface-id': 'fcc3370c-0323-4582-b412-16b172e60a4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:75:61', 'vm-uuid': '4c4aa7fe-9139-42de-8005-58da4eb1f132'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:17 user nova-compute[72894]: INFO os_vif [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03')
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:24:17 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No VIF found with MAC fa:16:3e:51:75:61, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated VIF entry in instance network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-855e88d8-5d40-4b25-84c3-a605b7dade39 req-75d776ce-7f7b-4861-980b-961ab3b6e51d service nova] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:24:18 user nova-compute[72894]: WARNING nova.compute.manager [req-82a60a18-be7a-4f71-a389-2e3766f71015 req-c241b4ac-6012-46bd-923c-5085f2eb9b35 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state None.
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:24:20 user nova-compute[72894]: WARNING nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state building and task_state spawning.
Aug 16 20:24:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:20 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:24:20 user nova-compute[72894]: WARNING nova.compute.manager [req-bcc49fa7-1c7a-48d5-93a5-289839dba297 req-7af2bc63-a43a-40c5-9bc1-7cab8394b6a4 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state building and task_state spawning.
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217461.4127316, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Resumed (Lifecycle Event)
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance spawned successfully.
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217461.4185467, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Started (Lifecycle Event)
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 16 20:24:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:21 user nova-compute[72894]: INFO nova.compute.manager [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Took 6.44 seconds to build instance.
Aug 16 20:24:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-3288e4e9-2bc3-4462-8162-3d8b47cb9ac1 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.585s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:24:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:31 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217456.8716998, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:24:31 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Stopped (Lifecycle Event)
Aug 16 20:24:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b3cf0bb3-b0f2-41b9-aac9-dec167e15313 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:24:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b3cf0bb3-b0f2-41b9-aac9-dec167e15313 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:24:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:24:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:24:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.26573944091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:24:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:24:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:24:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:24:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:24:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:24:58 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:24:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:25:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:25:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:25:55 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:25:55 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=24.265151977539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:25:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:25:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:25:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:25:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:25:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:25:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:25:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:26:00 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:26:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:26:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:26:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:26:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.compute.manager [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing instance network info cache due to event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated VIF entry in instance network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.network.neutron [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1fe110d-ab55-4a60-969e-5db7c950f538 req-6595c018-8bd9-4f6a-9fec-f44de1950a8f service nova] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:26:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'info_cache' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:26:07 user nova-compute[72894]: INFO nova.compute.manager [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] instance snapshotting
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:26:07 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Beginning live snapshot process
Aug 16 20:26:07 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance destroyed successfully.
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'resources' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG os_vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26af5b25-77, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:26:07 user nova-compute[72894]: INFO os_vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start _get_guest_xml network_info=[{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'numa_topology' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:26:07 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'pci_devices' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:26:07 user nova-compute[72894]:   <uuid>185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</uuid>
Aug 16 20:26:07 user nova-compute[72894]:   <name>instance-00000028</name>
Aug 16 20:26:07 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:26:07 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:26:07 user nova-compute[72894]:   <metadata>
Aug 16 20:26:07 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:26:07 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeTestJSON-server-2064230726</nova:name>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:26:07</nova:creationTime>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:26:07 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:26:07 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:owner>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:user uuid="181c019980b642c68023ff7283869af1">tempest-AttachVolumeTestJSON-1942038190-project-member</nova:user>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:project uuid="c04c911a91a94f6b843ce6d3419e0be1">tempest-AttachVolumeTestJSON-1942038190</nova:project>
Aug 16 20:26:07 user nova-compute[72894]:       </nova:owner>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:26:07 user nova-compute[72894]:       <nova:ports>
Aug 16 20:26:07 user nova-compute[72894]:         <nova:port uuid="26af5b25-77e0-492e-9991-d35c6d83b0a5">
Aug 16 20:26:07 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 20:26:07 user nova-compute[72894]:         </nova:port>
Aug 16 20:26:07 user nova-compute[72894]:       </nova:ports>
Aug 16 20:26:07 user nova-compute[72894]:     </nova:instance>
Aug 16 20:26:07 user nova-compute[72894]:   </metadata>
Aug 16 20:26:07 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:26:07 user nova-compute[72894]:     <system>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="serial">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="uuid">185cb39d-bad2-4e91-9cf3-a1eaba68a0b5</entry>
Aug 16 20:26:07 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:26:07 user nova-compute[72894]:     </system>
Aug 16 20:26:07 user nova-compute[72894]:   </sysinfo>
Aug 16 20:26:07 user nova-compute[72894]:   <os>
Aug 16 20:26:07 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:26:07 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:26:07 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:26:07 user nova-compute[72894]:   </os>
Aug 16 20:26:07 user nova-compute[72894]:   <features>
Aug 16 20:26:07 user nova-compute[72894]:     <acpi/>
Aug 16 20:26:07 user nova-compute[72894]:     <apic/>
Aug 16 20:26:07 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:26:07 user nova-compute[72894]:   </features>
Aug 16 20:26:07 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:26:07 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:26:07 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:26:07 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:26:07 user nova-compute[72894]:   </clock>
Aug 16 20:26:07 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:26:07 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:26:07 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:26:07 user nova-compute[72894]:   </cpu>
Aug 16 20:26:07 user nova-compute[72894]:   <devices>
Aug 16 20:26:07 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:26:07 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:26:07 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk"/>
Aug 16 20:26:07 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:26:07 user nova-compute[72894]:     </disk>
Aug 16 20:26:07 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:26:07 user nova-compute[72894]:       <mac address="fa:16:3e:51:67:92"/>
Aug 16 20:26:07 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:26:07 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:26:07 user nova-compute[72894]:       <target dev="tap26af5b25-77"/>
Aug 16 20:26:07 user nova-compute[72894]:     </interface>
Aug 16 20:26:07 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:26:07 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/console.log" append="off"/>
Aug 16 20:26:07 user nova-compute[72894]:     </serial>
Aug 16 20:26:07 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:26:07 user nova-compute[72894]:     <video>
Aug 16 20:26:07 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:26:07 user nova-compute[72894]:     </video>
Aug 16 20:26:07 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:26:07 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:26:07 user nova-compute[72894]:     </rng>
Aug 16 20:26:07 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:26:07 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:26:07 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:26:07 user nova-compute[72894]:     </memballoon>
Aug 16 20:26:07 user nova-compute[72894]:   </devices>
Aug 16 20:26:07 user nova-compute[72894]: </domain>
Aug 16 20:26:07 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json -f qcow2 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:07 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6.delta 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6.delta 1073741824" returned: 0 in 0.051s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:08 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Cannot resize image /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'migration_context' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG os_vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26af5b25-77, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26af5b25-77, col_values=(('external_ids', {'iface-id': '26af5b25-77e0-492e-9991-d35c6d83b0a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:67:92', 'vm-uuid': '185cb39d-bad2-4e91-9cf3-a1eaba68a0b5'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:08 user nova-compute[72894]: INFO os_vif [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:26:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:26:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72894) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 20:26:09 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 20:26:09 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:26:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6.delta /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6.delta /opt/stack/data/nova/instances/snapshots/tmpze0dn_ss/e36dfb4bcd8f40848e36ea7984d49bc6" returned: 0 in 0.559s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Snapshot extracted, beginning image upload
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:26:10 user nova-compute[72894]: WARNING nova.compute.manager [req-569e895a-3ded-4de2-841e-7158c7fb2b00 req-6e4613ac-b837-484b-a063-4191f3090388 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state powering-on.
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217572.6033914, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Resumed (Lifecycle Event)
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:26:12 user nova-compute[72894]: WARNING nova.compute.manager [req-bc324db5-de73-41ad-8c32-cd6400fae79c req-ebffd7e6-8c5b-42f2-a268-79e74105b0d3 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state stopped and task_state powering-on.
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance rebooted successfully.
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-6f3a5991-1130-457b-89fb-01a7bbc2f2b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Snapshot image upload complete
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.compute.manager [None req-74883030-2bb4-47bf-9d19-d30e6a943550 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Took 5.44 seconds to snapshot the instance on the hypervisor.
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217572.6178446, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:26:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Started (Lifecycle Event)
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:26:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:26:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:26:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:26:57 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:26:57 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=24.21471405029297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:26:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:26:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:27:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [{"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:27:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:27:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.compute.manager [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Terminating instance
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.manager [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-084a3bf4-68f3-42ce-93cd-cf9b3fb1344d req-ff7703b9-03dd-41bc-a576-3285dc4536c0 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-unplugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'flavor' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.compute.manager [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attaching volume 41e040b7-cd6b-4748-b320-841d5bf18723 to /dev/vdb
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.utils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffeedb2-2038-498d-8754-9a9ecc61891a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af50c4c-eeeb-41d9-8915-e11acacb1fc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c86a33-d9dc-47b4-89ff-f03d7a328848]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0312a-5e78-44e5-ab5c-2ebb1e5d822e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:27:58 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee502683-2c38-4c9e-8b13-89dc709db961]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_brick.utils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating existing volume attachment record: 5ca03adc-8749-46a5-8a91-fd32c9942482 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Instance destroyed successfully.
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'resources' on Instance uuid 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2064230726',display_name='tempest-AttachVolumeTestJSON-server-2064230726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2064230726',id=40,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASlep4lWfxcK63/a9j8cPdnUFygdZQHbbxflRORDOPxD49RnASnrdTPaZdTtNmTtNgxu1XmoZa/O/W1tiUdB2DM4VM2t8LjLf/ih/RnIeILiRCuwE9fZGl8wPErmpiUTg==',key_name='tempest-keypair-1177020854',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-mt41smgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=185cb39d-bad2-4e91-9cf3-a1eaba68a0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "address": "fa:16:3e:51:67:92", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26af5b25-77", "ovs_interfaceid": "26af5b25-77e0-492e-9991-d35c6d83b0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG os_vif [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26af5b25-77, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:27:58 user nova-compute[72894]: INFO os_vif [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:67:92,bridge_name='br-int',has_traffic_filtering=True,id=26af5b25-77e0-492e-9991-d35c6d83b0a5,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26af5b25-77')
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Deleting instance files /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5_del
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Deletion of /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5_del complete
Aug 16 20:27:58 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000028, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/185cb39d-bad2-4e91-9cf3-a1eaba68a0b5/disk
Aug 16 20:27:58 user nova-compute[72894]: INFO nova.compute.manager [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:27:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:27:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:27:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=24.213977813720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:27:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:00 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Took 1.19 seconds to deallocate network for instance.
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-7342bdda-406a-4df1-a9c1-bd54fa9d6c9d req-43f3ceb5-e6a7-4770-add5-90eb54211497 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-deleted-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:00 user nova-compute[72894]: INFO nova.compute.manager [req-7342bdda-406a-4df1-a9c1-bd54fa9d6c9d req-43f3ceb5-e6a7-4770-add5-90eb54211497 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Neutron deleted interface 26af5b25-77e0-492e-9991-d35c6d83b0a5; detaching it from the instance and deleting it from the info cache
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.network.neutron [req-7342bdda-406a-4df1-a9c1-bd54fa9d6c9d req-43f3ceb5-e6a7-4770-add5-90eb54211497 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-7342bdda-406a-4df1-a9c1-bd54fa9d6c9d req-43f3ceb5-e6a7-4770-add5-90eb54211497 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Detach interface failed, port_id=26af5b25-77e0-492e-9991-d35c6d83b0a5, reason: Instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] Acquiring lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] No waiting events found dispatching network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:00 user nova-compute[72894]: WARNING nova.compute.manager [req-f91d729d-d307-4806-95a9-81f94e2d767c req-ec72058f-ab8a-47a6-8afb-98ef4b759688 service nova] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Received unexpected event network-vif-plugged-26af5b25-77e0-492e-9991-d35c6d83b0a5 for instance with vm_state deleted and task_state None.
Aug 16 20:28:00 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Deleted allocations for instance 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5
Aug 16 20:28:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50544789-15ba-4986-92d1-fa1dd5fac013 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "185cb39d-bad2-4e91-9cf3-a1eaba68a0b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.561s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:28:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:13 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217678.8221674, 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:28:13 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] VM Stopped (Lifecycle Event)
Aug 16 20:28:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-06afe65e-2a89-4ddb-a4aa-d1bcb6948ddc None None] [instance: 185cb39d-bad2-4e91-9cf3-a1eaba68a0b5] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:28:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:28:14 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:28:14 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7581c488-b163-476c-949d-38d011a6ad9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:28:14 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb98c315-24e4-41e3-b7ee-6d52e95591a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723] added
Aug 16 20:28:14 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca31c97-25da-462b-9415-ede141727a0c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[152c97ae-06c8-40f0-adbe-8809d156a948]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNlMVedC {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNlMVedC" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c476dd-4573-4f24-86f2-5c9b2d2752b4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XNlMVedC'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2236635-1302-48e4-98b8-95165c92f5b9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e202c9-8048-4dd3-bbd3-c03dd82a90e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:28:15 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:28:15 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:28:15 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:28:15 user nova-compute[72894]: 
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ddfb18-0c67-45f9-98ef-c162a8c8aa92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260]
Aug 16 20:28:15 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260] successful.
Aug 16 20:28:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69bf4b-306f-4ade-8164-08c591564ba4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[249eeb9a-9c0c-49e0-ae22-86639d56d2e8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:28:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:28:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293598e-1f92-483e-af5d-206ed0b0a2a0]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26539613362653830', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539613362653830', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'flavor' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:28:16 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:28:16 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:28:16 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:28:16 user nova-compute[72894]:   <serial>41e040b7-cd6b-4748-b320-841d5bf18723</serial>
Aug 16 20:28:16 user nova-compute[72894]: </disk>
Aug 16 20:28:16 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No VIF found with MAC fa:16:3e:51:75:61, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:28:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f795c7bb-09a4-4bc8-a64c-ab25d568aa83 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.312s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:18 user nova-compute[72894]: INFO nova.compute.manager [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Rescuing
Aug 16 20:28:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG nova.network.neutron [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG nova.compute.manager [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:19 user nova-compute[72894]: WARNING nova.compute.manager [req-b146bf53-bf2f-4ae7-80b9-e12e8c485525 req-95241694-7dcc-40aa-83f3-c377b36c6b6a service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance destroyed successfully.
Aug 16 20:28:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attempting a stable device rescue
Aug 16 20:28:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72894) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance directory exists: not creating {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 20:28:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Creating image(s)
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.part --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.part --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG nova.virt.images [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] 1dc35c1e-8c9e-48cb-8c60-3030be31f85d was qcow2, converting to raw {{(pid=72894) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG nova.privsep.utils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72894) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 20:28:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.part /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.converted {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:21 user nova-compute[72894]: WARNING nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:21 user nova-compute[72894]: WARNING nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:21 user nova-compute[72894]: WARNING nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:21 user nova-compute[72894]: WARNING nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:21 user nova-compute[72894]: WARNING nova.compute.manager [req-aa09fa96-f970-4b18-96d5-9887f8b70d2e req-5c338565-da84-4478-bd12-da44b5722d90 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.part /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.converted" returned: 0 in 0.702s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.converted --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.211s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a,backing_fmt=raw /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a,backing_fmt=raw /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4a22d3224b000a0ce93f4e6ec87532a3e410e54a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'migration_context' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start _get_guest_xml network_info=[{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "vif_mac": "fa:16:3e:51:75:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1dc35c1e-8c9e-48cb-8c60-3030be31f85d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '5ca03adc-8749-46a5-8a91-fd32c9942482', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4c4aa7fe-9139-42de-8005-58da4eb1f132', 'attached_at': '', 'detached_at': '', 'volume_id': '41e040b7-cd6b-4748-b320-841d5bf18723', 'serial': '41e040b7-cd6b-4748-b320-841d5bf18723'}, 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'resources' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:28:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:28:22 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:28:22 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:28:22 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d2aa11-888f-48d5-9179-b630d2fc95b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XNlMVedC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 20:28:22 user nova-compute[72894]: node.name = iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723
Aug 16 20:28:22 user nova-compute[72894]: node.tpgt = -1
Aug 16 20:28:22 user nova-compute[72894]: node.startup = automatic
Aug 16 20:28:22 user nova-compute[72894]: node.leading_login = No
Aug 16 20:28:22 user nova-compute[72894]: iface.iscsi_ifacename = default
Aug 16 20:28:22 user nova-compute[72894]: iface.net_ifacename = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.ipaddress = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.prefix_len = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.hwaddress = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.transport_name = tcp
Aug 16 20:28:22 user nova-compute[72894]: iface.initiatorname = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.vlan_id = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.vlan_priority = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.vlan_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.iface_num = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.mtu = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.port = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.bootproto = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.subnet_mask = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.gateway = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_alt_client_id = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_dns = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_learn_iqn = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_vendor_id_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_vendor_id = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.dhcp_slp_da = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.fragmentation = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.gratuitous_arp = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.incoming_forwarding = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.tos_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.tos = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.ttl = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.delayed_ack = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.tcp_nagle = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.tcp_wsf_state = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.tcp_wsf = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.tcp_timer_scale = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.tcp_timestamp = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.redirect = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.def_task_mgmt_timeout = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.header_digest = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.data_digest = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.immediate_data = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.initial_r2t = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.data_seq_inorder = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.data_pdu_inorder = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.erl = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.max_receive_data_len = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.first_burst_len = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.max_outstanding_r2t = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.max_burst_len = 0
Aug 16 20:28:22 user nova-compute[72894]: iface.chap_auth = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.bidi_chap = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.strict_login_compliance = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.discovery_auth = <empty>
Aug 16 20:28:22 user nova-compute[72894]: iface.discovery_logout = <empty>
Aug 16 20:28:22 user nova-compute[72894]: node.discovery_address = <empty>
Aug 16 20:28:22 user nova-compute[72894]: node.discovery_port = 0
Aug 16 20:28:22 user nova-compute[72894]: node.discovery_type = static
Aug 16 20:28:22 user nova-compute[72894]: node.session.initial_cmdsn = 0
Aug 16 20:28:22 user nova-compute[72894]: node.session.initial_login_retry_max = 8
Aug 16 20:28:22 user nova-compute[72894]: node.session.xmit_thread_priority = -20
Aug 16 20:28:22 user nova-compute[72894]: node.session.cmds_max = 128
Aug 16 20:28:22 user nova-compute[72894]: node.session.queue_depth = 32
Aug 16 20:28:22 user nova-compute[72894]: node.session.nr_sessions = 1
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.authmethod = CHAP
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.username = XNlMVedC
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.password = ***
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.username_in = <empty>
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.password_in = <empty>
Aug 16 20:28:22 user nova-compute[72894]: node.session.auth.chap_algs = MD5
Aug 16 20:28:22 user nova-compute[72894]: node.session.timeo.replacement_timeout = 120
Aug 16 20:28:22 user nova-compute[72894]: node.session.err_timeo.abort_timeout = 15
Aug 16 20:28:22 user nova-compute[72894]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 20:28:22 user nova-compute[72894]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 20:28:22 user nova-compute[72894]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.FastAbort = Yes
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.InitialR2T = No
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.ImmediateData = Yes
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.MaxConnections = 1
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 20:28:22 user nova-compute[72894]: node.session.iscsi.ERL = 0
Aug 16 20:28:22 user nova-compute[72894]: node.session.scan = manual
Aug 16 20:28:22 user nova-compute[72894]: node.session.reopen_max = 0
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].address = 172.16.0.220
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].port = 3260
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].startup = manual
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].tcp.window_size = 524288
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].tcp.type_of_service = 0
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].timeo.logout_timeout = 15
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].timeo.login_timeout = 15
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].timeo.auth_timeout = 45
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.DataDigest = None
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.IFMarker = No
Aug 16 20:28:22 user nova-compute[72894]: node.conn[0].iscsi.OFMarker = No
Aug 16 20:28:22 user nova-compute[72894]: # END RECORD
Aug 16 20:28:22 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189102c-b40c-44f4-afc3-47029e4866b5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a51ead-9361-4ebe-9868-9f996c1ff571]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNlMVedC {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNlMVedC" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52c685-a39a-4e69-abb0-59f941e70952]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XNlMVedC'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[89414b03-f710-47b3-afb9-4bd5c3ea6019]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00ce2f-f2bf-440d-b733-c59cda05e7f0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:28:22 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:28:22 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.124s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] HCTL ('33', '0', '0', 0) found on session 53 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0dfe0-2d8d-4728-a887-5e41bae02371]: (4, ('0 0 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Searching for a device in session 53 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.145s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] <== connect_volume: return (146ms) {'type': 'block', 'scsi_wwn': '26539613362653830', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539613362653830', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977989885',display_name='tempest-ServerStableDeviceRescueTest-server-1977989885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977989885',id=43,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZMr6pNSznnDGIGmSFjzQZdvoa9cDVOWHRhlu/lkgPaqaeYwXZXThOp7cdgYGgL0TXx/5TgqEcfpAmopBN+ErE2TUrvUu4m1trVZfbCJZOxh+T0wDBaPuKqvep4Vr+Rw==',key_name='tempest-keypair-54417522',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c093167d32ce4486a1da4f1688d2a5b8',ramdisk_id='',reservation_id='r-shud9vcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-911931366',owner_user_name='tempest-ServerStableDeviceRescueTest-911931366-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86770bea7ddc440b8c1a3e81adb24cc4',uuid=4c4aa7fe-9139-42de-8005-58da4eb1f132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "vif_mac": "fa:16:3e:51:75:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converting VIF {"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "vif_mac": "fa:16:3e:51:75:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:28:22 user nova-compute[72894]:   <uuid>4c4aa7fe-9139-42de-8005-58da4eb1f132</uuid>
Aug 16 20:28:22 user nova-compute[72894]:   <name>instance-0000002b</name>
Aug 16 20:28:22 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:28:22 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:28:22 user nova-compute[72894]:   <metadata>
Aug 16 20:28:22 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:28:22 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1977989885</nova:name>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:28:22</nova:creationTime>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:28:22 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:28:22 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:owner>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:user uuid="86770bea7ddc440b8c1a3e81adb24cc4">tempest-ServerStableDeviceRescueTest-911931366-project-member</nova:user>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:project uuid="c093167d32ce4486a1da4f1688d2a5b8">tempest-ServerStableDeviceRescueTest-911931366</nova:project>
Aug 16 20:28:22 user nova-compute[72894]:       </nova:owner>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:28:22 user nova-compute[72894]:       <nova:ports>
Aug 16 20:28:22 user nova-compute[72894]:         <nova:port uuid="fcc3370c-0323-4582-b412-16b172e60a4c">
Aug 16 20:28:22 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 20:28:22 user nova-compute[72894]:         </nova:port>
Aug 16 20:28:22 user nova-compute[72894]:       </nova:ports>
Aug 16 20:28:22 user nova-compute[72894]:     </nova:instance>
Aug 16 20:28:22 user nova-compute[72894]:   </metadata>
Aug 16 20:28:22 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:28:22 user nova-compute[72894]:     <system>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="serial">4c4aa7fe-9139-42de-8005-58da4eb1f132</entry>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="uuid">4c4aa7fe-9139-42de-8005-58da4eb1f132</entry>
Aug 16 20:28:22 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:28:22 user nova-compute[72894]:     </system>
Aug 16 20:28:22 user nova-compute[72894]:   </sysinfo>
Aug 16 20:28:22 user nova-compute[72894]:   <os>
Aug 16 20:28:22 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:28:22 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:28:22 user nova-compute[72894]:   </os>
Aug 16 20:28:22 user nova-compute[72894]:   <features>
Aug 16 20:28:22 user nova-compute[72894]:     <acpi/>
Aug 16 20:28:22 user nova-compute[72894]:     <apic/>
Aug 16 20:28:22 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:28:22 user nova-compute[72894]:   </features>
Aug 16 20:28:22 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:28:22 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:28:22 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:28:22 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:28:22 user nova-compute[72894]:   </clock>
Aug 16 20:28:22 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:28:22 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:28:22 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:28:22 user nova-compute[72894]:   </cpu>
Aug 16 20:28:22 user nova-compute[72894]:   <devices>
Aug 16 20:28:22 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:28:22 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:28:22 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk"/>
Aug 16 20:28:22 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:28:22 user nova-compute[72894]:     </disk>
Aug 16 20:28:22 user nova-compute[72894]:     <disk type="block" device="disk">
Aug 16 20:28:22 user nova-compute[72894]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:28:22 user nova-compute[72894]:       <source dev="/dev/sdb"/>
Aug 16 20:28:22 user nova-compute[72894]:       <target dev="vdb" bus="virtio"/>
Aug 16 20:28:22 user nova-compute[72894]:       <serial>41e040b7-cd6b-4748-b320-841d5bf18723</serial>
Aug 16 20:28:22 user nova-compute[72894]:     </disk>
Aug 16 20:28:22 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:28:22 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:28:22 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue"/>
Aug 16 20:28:22 user nova-compute[72894]:       <target dev="vdc" bus="virtio"/>
Aug 16 20:28:22 user nova-compute[72894]:       <boot order="1"/>
Aug 16 20:28:22 user nova-compute[72894]:     </disk>
Aug 16 20:28:22 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:28:22 user nova-compute[72894]:       <mac address="fa:16:3e:51:75:61"/>
Aug 16 20:28:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:28:22 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:28:22 user nova-compute[72894]:       <target dev="tapfcc3370c-03"/>
Aug 16 20:28:22 user nova-compute[72894]:     </interface>
Aug 16 20:28:22 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:28:22 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/console.log" append="off"/>
Aug 16 20:28:22 user nova-compute[72894]:     </serial>
Aug 16 20:28:22 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:28:22 user nova-compute[72894]:     <video>
Aug 16 20:28:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:28:22 user nova-compute[72894]:     </video>
Aug 16 20:28:22 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:28:22 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:28:22 user nova-compute[72894]:     </rng>
Aug 16 20:28:22 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:28:22 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:28:22 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:28:22 user nova-compute[72894]:     </memballoon>
Aug 16 20:28:22 user nova-compute[72894]:   </devices>
Aug 16 20:28:22 user nova-compute[72894]: </domain>
Aug 16 20:28:22 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:28:22 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance destroyed successfully.
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] No VIF found with MAC fa:16:3e:51:75:61, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:28:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:24 user nova-compute[72894]: WARNING nova.compute.manager [req-526f110a-e939-4979-b900-12be086f56c0 req-d1bdacaf-361f-4dae-8410-6646dde96a35 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:26 user nova-compute[72894]: WARNING nova.compute.manager [req-38372ed2-4c00-429f-9a3a-8ee402c91214 req-505f2725-44e2-4490-87c1-57c2825a2a72 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state active and task_state rescuing.
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 4c4aa7fe-9139-42de-8005-58da4eb1f132 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217706.1834614, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:28:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Resumed (Lifecycle Event)
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e2a2caa5-a070-4c4a-ab98-62dd4f9ad458 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:28:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217706.1854746, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:28:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Started (Lifecycle Event)
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:28:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:28:51 user nova-compute[72894]: INFO nova.compute.claims [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Claim successful on node user
Aug 16 20:28:51 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:28:51 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:28:52 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.policy [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '181c019980b642c68023ff7283869af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04c911a91a94f6b843ce6d3419e0be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:28:52 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Creating image(s)
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "/opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "/opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk 1073741824" returned: 0 in 0.060s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Successfully created port: 450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:28:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Cannot resize image /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'migration_context' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Ensure instance console log exists: /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Successfully updated port: 450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquired lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-changed-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.compute.manager [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Refreshing instance network info cache due to event network-changed-450997e7-0be1-4aaf-a78b-e15a8a426261. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] Acquiring lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:28:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating instance_info_cache with network_info: [{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Releasing lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Instance network_info: |[{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] Acquired lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.neutron [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Refreshing network info cache for port 450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Start _get_guest_xml network_info=[{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:28:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:28:54 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515313040',display_name='tempest-AttachVolumeTestJSON-server-1515313040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515313040',id=44,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlt7Co59mxy7Jnu/71VB6utHZ8tGQoOKz0fpmu+/CFwMQe39L931zsFuiaF6OdoECN10TgwtWmJGiTlP/7R/crMnakDmIwtqa9+Itn3Ed69jqKzil5OXdt/gR4hxKELDg==',key_name='tempest-keypair-1535364573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-286oa74k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=a8097cb6-3257-4d91-8067-2ad4a98db428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'pci_devices' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:28:54 user nova-compute[72894]:   <uuid>a8097cb6-3257-4d91-8067-2ad4a98db428</uuid>
Aug 16 20:28:54 user nova-compute[72894]:   <name>instance-0000002c</name>
Aug 16 20:28:54 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:28:54 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:28:54 user nova-compute[72894]:   <metadata>
Aug 16 20:28:54 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:28:54 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeTestJSON-server-1515313040</nova:name>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:28:54</nova:creationTime>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:28:54 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:28:54 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:owner>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:user uuid="181c019980b642c68023ff7283869af1">tempest-AttachVolumeTestJSON-1942038190-project-member</nova:user>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:project uuid="c04c911a91a94f6b843ce6d3419e0be1">tempest-AttachVolumeTestJSON-1942038190</nova:project>
Aug 16 20:28:54 user nova-compute[72894]:       </nova:owner>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:28:54 user nova-compute[72894]:       <nova:ports>
Aug 16 20:28:54 user nova-compute[72894]:         <nova:port uuid="450997e7-0be1-4aaf-a78b-e15a8a426261">
Aug 16 20:28:54 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 20:28:54 user nova-compute[72894]:         </nova:port>
Aug 16 20:28:54 user nova-compute[72894]:       </nova:ports>
Aug 16 20:28:54 user nova-compute[72894]:     </nova:instance>
Aug 16 20:28:54 user nova-compute[72894]:   </metadata>
Aug 16 20:28:54 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:28:54 user nova-compute[72894]:     <system>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="serial">a8097cb6-3257-4d91-8067-2ad4a98db428</entry>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="uuid">a8097cb6-3257-4d91-8067-2ad4a98db428</entry>
Aug 16 20:28:54 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:28:54 user nova-compute[72894]:     </system>
Aug 16 20:28:54 user nova-compute[72894]:   </sysinfo>
Aug 16 20:28:54 user nova-compute[72894]:   <os>
Aug 16 20:28:54 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:28:54 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:28:54 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:28:54 user nova-compute[72894]:   </os>
Aug 16 20:28:54 user nova-compute[72894]:   <features>
Aug 16 20:28:54 user nova-compute[72894]:     <acpi/>
Aug 16 20:28:54 user nova-compute[72894]:     <apic/>
Aug 16 20:28:54 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:28:54 user nova-compute[72894]:   </features>
Aug 16 20:28:54 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:28:54 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:28:54 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:28:54 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:28:54 user nova-compute[72894]:   </clock>
Aug 16 20:28:54 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:28:54 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:28:54 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:28:54 user nova-compute[72894]:   </cpu>
Aug 16 20:28:54 user nova-compute[72894]:   <devices>
Aug 16 20:28:54 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:28:54 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:28:54 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk"/>
Aug 16 20:28:54 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:28:54 user nova-compute[72894]:     </disk>
Aug 16 20:28:54 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:28:54 user nova-compute[72894]:       <mac address="fa:16:3e:23:ec:42"/>
Aug 16 20:28:54 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:28:54 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:28:54 user nova-compute[72894]:       <target dev="tap450997e7-0b"/>
Aug 16 20:28:54 user nova-compute[72894]:     </interface>
Aug 16 20:28:54 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:28:54 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/console.log" append="off"/>
Aug 16 20:28:54 user nova-compute[72894]:     </serial>
Aug 16 20:28:54 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:28:54 user nova-compute[72894]:     <video>
Aug 16 20:28:54 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:28:54 user nova-compute[72894]:     </video>
Aug 16 20:28:54 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:28:54 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:28:54 user nova-compute[72894]:     </rng>
Aug 16 20:28:54 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:28:54 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:28:54 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:28:54 user nova-compute[72894]:     </memballoon>
Aug 16 20:28:54 user nova-compute[72894]:   </devices>
Aug 16 20:28:54 user nova-compute[72894]: </domain>
Aug 16 20:28:54 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515313040',display_name='tempest-AttachVolumeTestJSON-server-1515313040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515313040',id=44,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlt7Co59mxy7Jnu/71VB6utHZ8tGQoOKz0fpmu+/CFwMQe39L931zsFuiaF6OdoECN10TgwtWmJGiTlP/7R/crMnakDmIwtqa9+Itn3Ed69jqKzil5OXdt/gR4hxKELDg==',key_name='tempest-keypair-1535364573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-286oa74k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=a8097cb6-3257-4d91-8067-2ad4a98db428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG os_vif [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap450997e7-0b, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap450997e7-0b, col_values=(('external_ids', {'iface-id': '450997e7-0be1-4aaf-a78b-e15a8a426261', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ec:42', 'vm-uuid': 'a8097cb6-3257-4d91-8067-2ad4a98db428'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:54 user nova-compute[72894]: INFO os_vif [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b')
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No VIF found with MAC fa:16:3e:23:ec:42, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.neutron [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updated VIF entry in instance network info cache for port 450997e7-0be1-4aaf-a78b-e15a8a426261. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG nova.network.neutron [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating instance_info_cache with network_info: [{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cdb75eb3-cfe0-4bdb-a375-ca91ff5cebd8 req-a9a4b345-5193-4ad8-80c5-c428330f8bcf service nova] Releasing lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:28:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] No waiting events found dispatching network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:55 user nova-compute[72894]: WARNING nova.compute.manager [req-6b981c8d-06e4-46c2-9259-aceb7e80b10d req-cceafd87-e6b0-4993-bca7-0d54c84da23e service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received unexpected event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 for instance with vm_state building and task_state spawning.
Aug 16 20:28:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217737.6861897, a8097cb6-3257-4d91-8067-2ad4a98db428 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] VM Resumed (Lifecycle Event)
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Instance spawned successfully.
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217737.6894915, a8097cb6-3257-4d91-8067-2ad4a98db428 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] VM Started (Lifecycle Event)
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] No waiting events found dispatching network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:28:57 user nova-compute[72894]: WARNING nova.compute.manager [req-1cec57fd-0d4d-4f14-a56c-ed4fcb2e974d req-72635b87-deb5-4a15-b425-67e743187f1b service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received unexpected event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 for instance with vm_state building and task_state spawning.
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 16 20:28:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:28:57 user nova-compute[72894]: INFO nova.compute.manager [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Took 6.19 seconds to build instance.
Aug 16 20:28:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f8fc7fba-d6de-47a9-a4a3-f2045e0619b4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.287s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:28:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:28:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:28:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:29:01 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:29:01 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:29:01 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=24.143653869628906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:29:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a8097cb6-3257-4d91-8067-2ad4a98db428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:29:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:04 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:29:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:29:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:29:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:29:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:29:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:29:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:29:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:04 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:30:04 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=24.115070343017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a8097cb6-3257-4d91-8067-2ad4a98db428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:30:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating instance_info_cache with network_info: [{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:30:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:30:09 user nova-compute[72894]: INFO nova.compute.manager [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Unrescuing
Aug 16 20:30:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:30:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:30:09 user nova-compute[72894]: DEBUG nova.network.neutron [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG nova.objects.instance [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'flavor' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:30:10 user nova-compute[72894]: WARNING nova.compute.manager [req-35d2802a-990f-40f4-9584-7c94e4ef3fab req-b14b32c3-d6e5-4fa3-878f-1c7c223e44bc service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:30:10 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance destroyed successfully.
Aug 16 20:30:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:30:12 user nova-compute[72894]: WARNING nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:30:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing instance network info cache due to event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:30:12 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated VIF entry in instance network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing instance network info cache due to event network-changed-fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Refreshing network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated VIF entry in instance network info cache for port fcc3370c-0323-4582-b412-16b172e60a4c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.network.neutron [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:30:13 user nova-compute[72894]: WARNING nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:13 user nova-compute[72894]: DEBUG nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:30:13 user nova-compute[72894]: WARNING nova.compute.manager [req-0ec9a8f5-e4c0-4df1-be30-b389d8efab91 req-b73e5bbe-b80c-47e6-8a3f-7930aecafd71 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state rescued and task_state unrescuing.
Aug 16 20:30:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Removed pending event for 4c4aa7fe-9139-42de-8005-58da4eb1f132 due to event {{(pid=72894) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217814.429676, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:30:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Resumed (Lifecycle Event)
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-49920f2b-3e3c-4092-8d81-ad16fdc3a3cc tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:30:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217814.4335718, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:30:14 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Started (Lifecycle Event)
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:30:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-changed-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:30:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Refreshing instance network info cache due to event network-changed-450997e7-0be1-4aaf-a78b-e15a8a426261. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:30:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] Acquiring lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:30:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] Acquired lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:30:42 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Refreshing network info cache for port 450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:43 user nova-compute[72894]: INFO nova.compute.manager [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Detaching volume 41e040b7-cd6b-4748-b320-841d5bf18723
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updated VIF entry in instance network info cache for port 450997e7-0be1-4aaf-a78b-e15a8a426261. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.network.neutron [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating instance_info_cache with network_info: [{"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d6ce70e9-bbca-42e6-9d6d-0b355fe7faf3 req-d6839744-0bbd-4813-9e2e-3550fcbadcc2 service nova] Releasing lock "refresh_cache-a8097cb6-3257-4d91-8067-2ad4a98db428" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:30:43 user nova-compute[72894]: INFO nova.virt.block_device [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Attempting to driver detach volume 41e040b7-cd6b-4748-b320-841d5bf18723 from mountpoint /dev/vdb
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Attempting to detach device vdb from instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:30:43 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:30:43 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:30:43 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:30:43 user nova-compute[72894]:   <serial>41e040b7-cd6b-4748-b320-841d5bf18723</serial>
Aug 16 20:30:43 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:30:43 user nova-compute[72894]: </disk>
Aug 16 20:30:43 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:30:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Successfully detached device vdb from instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 from the persistent domain config.
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:30:43 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:30:43 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:30:43 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:30:43 user nova-compute[72894]:   <serial>41e040b7-cd6b-4748-b320-841d5bf18723</serial>
Aug 16 20:30:43 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:30:43 user nova-compute[72894]: </disk>
Aug 16 20:30:43 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217843.6645222, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:30:43 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Successfully detached device vdb from instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 from the live domain config.
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNlMVedC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:30:43 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[346bfc42-8070-4261-b486-fecd24f2bb55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c53731-4bf1-4405-97fa-9e8347ebba79]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:30:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 (non-flash)
Aug 16 20:30:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c3637f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82089f5-258f-47da-9b29-4c23553d507a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff78c2-5039-472e-acf7-83b94c01395e]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261bf35-20de-470b-a757-3d299bccbcca]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[109ed035-fb01-4207-9a75-abfccbde7aed]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[be444549-4c35-4d8e-a83a-834d5ddda191]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b015a-43d1-4219-9109-8c1968fdd50c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260]
Aug 16 20:30:43 user nova-compute[72894]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723, portal: 172.16.0.220,3260] successful.
Aug 16 20:30:43 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e040b7-cd6b-4748-b320-841d5bf18723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[73758c0e-e8df-4080-862a-e8abbe18cde3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] <== disconnect_volume: return (303ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:30:43 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:30:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:44 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'flavor' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:30:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c78869b3-4847-4c15-a884-b50fa7276740 tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:30:46 user nova-compute[72894]: INFO nova.compute.manager [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attaching volume 03d5d772-8546-4dc1-887d-7df6e77c2d4f to /dev/vdb
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.utils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[082be7fe-e005-40e6-904f-daea7c47a88f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef5b5f-1b1a-4c2c-9c69-d657b46b2064]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b525d58-0054-4c14-949d-08085aa0e049]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0661d457-93f6-431d-b286-a5ff0a67030f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:30:46 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:30:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf7ce5d-f77a-47a7-bd29-2dc296cafd90]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG os_brick.utils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:30:46 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating existing volume attachment record: 570ec136-033e-4313-87b6-344f4ff3f87e {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:30:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edQTgSAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:30:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:30:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:30:56 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbc85e4-143f-408f-9114-45ae72c28a3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:30:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96da04-2d6b-4c22-9810-c0cbc3471313]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f] added
Aug 16 20:30:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa153ab8-1835-4f20-bbc3-ee66ef7087ef]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb063b-8027-435d-9d23-f9713c09593b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edQTgSAx {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edQTgSAx" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20afa8-c770-4f8c-a25c-b8174b6e5db8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edQTgSAx'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2bf1bc-1b95-4ebd-b060-e3377df05077]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9526c9d-5d6f-48f7-ac90-c2fc9f8e8f22]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:30:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:30:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:30:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:30:56 user nova-compute[72894]: 
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7be54e-6f4a-47ab-b4e3-0aef39453135]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260]
Aug 16 20:30:56 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260] successful.
Aug 16 20:30:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e1441c-051c-4c28-b7ea-f6d69d87c710]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[372eba5d-d965-4d3a-9099-15061cc8a6fa]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:30:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:30:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98806d6-3a3a-4220-b20e-b4a2667d6883]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:30:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edQTgSAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23238376131643563', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238376131643563', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:30:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:30:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:30:57 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:30:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:30:57 user nova-compute[72894]:   <serial>03d5d772-8546-4dc1-887d-7df6e77c2d4f</serial>
Aug 16 20:30:57 user nova-compute[72894]: </disk>
Aug 16 20:30:57 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No VIF found with MAC fa:16:3e:23:ec:42, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f7aba6d0-2a12-444d-ace2-1133ddb2bfe3 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.743s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:30:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:30:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:02 user nova-compute[72894]: INFO nova.compute.manager [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attaching volume 27b46b2c-a9bd-404b-ba78-118127fc5698 to /dev/vdc
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.utils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1402c83-da33-4d2f-a2ee-aca87140014d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d92a98-a5d6-4ce4-90c3-275985fab5b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5401cb6b-4aec-434d-b9ab-4996adacc83c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bceaa26-eaa4-4bdc-8c99-08c0a89d45d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:31:02 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:31:02 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e02cd-a0e2-49a4-94ef-26898e2a4225]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG os_brick.utils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:31:02 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating existing volume attachment record: dfbae4fe-d4bd-4a16-99f3-81344621c63e {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:31:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:04 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:31:04 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=24.106456756591797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a8097cb6-3257-4d91-8067-2ad4a98db428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:31:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:31:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [{"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4c4aa7fe-9139-42de-8005-58da4eb1f132" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUCoMdwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:31:12 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:31:12 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:31:12 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[35979852-11e1-4c88-af8e-59c1b6598bce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:31:12 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e141134-b8c1-4da1-b25b-0abdddbf819e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698] added
Aug 16 20:31:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef0fed-f325-4615-a356-c0dbed925108]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[58000b56-56ff-43a9-bfa7-1da50b012a6b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUCoMdwD {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUCoMdwD" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a4227e-75ad-400c-9153-0848058bf8da]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TUCoMdwD'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b9e27-fe94-4ba9-9841-26c018b77612]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ed7e0-d799-451e-9aa0-60d080a86da1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:12 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:31:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b6d6e-2429-4f1d-bb44-bfef7de5c9f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260]
Aug 16 20:31:13 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260] successful.
Aug 16 20:31:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50be1d-987a-4d3e-af65-5d6bdb402109]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d45914-df46-4001-a70b-1e704fabc4ba]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:13 user nova-compute[72894]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:13 user nova-compute[72894]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:13 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e00cf6-51c6-449b-96c9-3cff90d0075f]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:31:13 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUCoMdwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26464363034313535', 'path': '/dev/sdc'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464363034313535', 'path': '/dev/sdc'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.objects.instance [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:31:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:31:14 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:31:14 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:31:14 user nova-compute[72894]:   <serial>27b46b2c-a9bd-404b-ba78-118127fc5698</serial>
Aug 16 20:31:14 user nova-compute[72894]: </disk>
Aug 16 20:31:14 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] No VIF found with MAC fa:16:3e:23:ec:42, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71c5deb9-4383-4fb0-b0e5-44aa2a1ea13c tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.041s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:16 user nova-compute[72894]: INFO nova.compute.manager [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Detaching volume 03d5d772-8546-4dc1-887d-7df6e77c2d4f
Aug 16 20:31:16 user nova-compute[72894]: INFO nova.virt.block_device [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attempting to driver detach volume 03d5d772-8546-4dc1-887d-7df6e77c2d4f from mountpoint /dev/vdb
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Attempting to detach device vdb from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:31:16 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:31:16 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:31:16 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:31:16 user nova-compute[72894]:   <serial>03d5d772-8546-4dc1-887d-7df6e77c2d4f</serial>
Aug 16 20:31:16 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:31:16 user nova-compute[72894]: </disk>
Aug 16 20:31:16 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:31:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdb from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the persistent domain config.
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:31:16 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:31:16 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:31:16 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:31:16 user nova-compute[72894]:   <serial>03d5d772-8546-4dc1-887d-7df6e77c2d4f</serial>
Aug 16 20:31:16 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:31:16 user nova-compute[72894]: </disk>
Aug 16 20:31:16 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217876.6653957, a8097cb6-3257-4d91-8067-2ad4a98db428 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:31:16 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdb from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the live domain config.
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edQTgSAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:31:16 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1afd462-eb1f-4133-91c7-dbbe1c593eea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d6d3b7-f2c2-4d10-8f9e-bf8b759cb93b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:16 user nova-compute[72894]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:16 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f (non-flash)
Aug 16 20:31:16 user nova-compute[72894]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:16 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c7256c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc610ad0-9505-4524-8dbc-b2c2df658ca2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a05e4-8b61-436b-9465-0c9df1e99594]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ccc1bf-fd06-4555-bf32-cda11763f93e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3679ecd-056b-451d-b7c0-0d29786bbf6b]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4eb83-e647-49f4-9ae2-f3becd227cc7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[767de008-7d49-4cb8-8c4a-77f7553672e3]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260]
Aug 16 20:31:16 user nova-compute[72894]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f, portal: 172.16.0.220,3260] successful.
Aug 16 20:31:16 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d5d772-8546-4dc1-887d-7df6e77c2d4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa67732-57e3-49bd-b6e8-221048280cc0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== disconnect_volume: return (274ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:31:16 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:31:17 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b7fff006-1bee-421a-8028-804022707e18 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:18 user nova-compute[72894]: INFO nova.compute.manager [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Detaching volume 27b46b2c-a9bd-404b-ba78-118127fc5698
Aug 16 20:31:18 user nova-compute[72894]: INFO nova.virt.block_device [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Attempting to driver detach volume 27b46b2c-a9bd-404b-ba78-118127fc5698 from mountpoint /dev/vdc
Aug 16 20:31:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Attempting to detach device vdc from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:31:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:31:18 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:31:18 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:31:18 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:31:18 user nova-compute[72894]:   <serial>27b46b2c-a9bd-404b-ba78-118127fc5698</serial>
Aug 16 20:31:18 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:31:18 user nova-compute[72894]: </disk>
Aug 16 20:31:18 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:31:18 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdc from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the persistent domain config.
Aug 16 20:31:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:31:18 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:31:18 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:31:18 user nova-compute[72894]:   <source dev="/dev/sdc"/>
Aug 16 20:31:18 user nova-compute[72894]:   <target dev="vdc" bus="virtio"/>
Aug 16 20:31:18 user nova-compute[72894]:   <serial>27b46b2c-a9bd-404b-ba78-118127fc5698</serial>
Aug 16 20:31:18 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 20:31:18 user nova-compute[72894]: </disk>
Aug 16 20:31:18 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692217879.017028, a8097cb6-3257-4d91-8067-2ad4a98db428 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:31:19 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully detached device vdc from instance a8097cb6-3257-4d91-8067-2ad4a98db428 from the live domain config.
Aug 16 20:31:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUCoMdwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:31:19 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2cef8a-eb5a-49ac-8bc3-04cda45252ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f718d-8556-4d8e-9fa3-73e01d4cdc1a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 (non-flash)
Aug 16 20:31:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990435ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698'): ({'sdc'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Removing single pathed devices sdc {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49a7ea-ac85-42e9-99a7-695fca13f381]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f27972c-4b66-432e-8ecd-360596cea963]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Flushing IO for device /dev/sdc {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc3280-cdfe-4f30-a1bb-a5459f274bb8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5470ab01-cc47-4f39-994b-039f70a0a8d2]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] SCSI volumes sdc have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[93583d88-ee6a-462b-8125-85228da783c7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6d7fd-d100-40dc-9fc3-8ea5f37a0b31]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260]
Aug 16 20:31:19 user nova-compute[72894]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698, portal: 172.16.0.220,3260] successful.
Aug 16 20:31:19 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27b46b2c-a9bd-404b-ba78-118127fc5698 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f2a04-4249-43c8-81ae-ad5a96eda34b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] <== disconnect_volume: return (276ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'flavor' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-316aa823-47a3-40af-8fc1-36d2b5ba7259 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.597s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:21 user nova-compute[72894]: INFO nova.compute.manager [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Terminating instance
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-unplugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] No waiting events found dispatching network-vif-unplugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-50a59f49-2387-45fd-8f2f-29f9049af181 req-c291646f-ac0c-40c5-84b7-58f7915f4360 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-unplugged-450997e7-0be1-4aaf-a78b-e15a8a426261 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Instance destroyed successfully.
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lazy-loading 'resources' on Instance uuid a8097cb6-3257-4d91-8067-2ad4a98db428 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515313040',display_name='tempest-AttachVolumeTestJSON-server-1515313040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515313040',id=44,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlt7Co59mxy7Jnu/71VB6utHZ8tGQoOKz0fpmu+/CFwMQe39L931zsFuiaF6OdoECN10TgwtWmJGiTlP/7R/crMnakDmIwtqa9+Itn3Ed69jqKzil5OXdt/gR4hxKELDg==',key_name='tempest-keypair-1535364573',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c04c911a91a94f6b843ce6d3419e0be1',ramdisk_id='',reservation_id='r-286oa74k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1942038190',owner_user_name='tempest-AttachVolumeTestJSON-1942038190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='181c019980b642c68023ff7283869af1',uuid=a8097cb6-3257-4d91-8067-2ad4a98db428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converting VIF {"id": "450997e7-0be1-4aaf-a78b-e15a8a426261", "address": "fa:16:3e:23:ec:42", "network": {"id": "6201182b-98f0-47d3-a92a-96c99ba49c8b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2044221690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04c911a91a94f6b843ce6d3419e0be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450997e7-0b", "ovs_interfaceid": "450997e7-0be1-4aaf-a78b-e15a8a426261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG os_vif [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap450997e7-0b, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:21 user nova-compute[72894]: INFO os_vif [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=450997e7-0be1-4aaf-a78b-e15a8a426261,network=Network(6201182b-98f0-47d3-a92a-96c99ba49c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450997e7-0b')
Aug 16 20:31:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Deleting instance files /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428_del
Aug 16 20:31:21 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Deletion of /opt/stack/data/nova/instances/a8097cb6-3257-4d91-8067-2ad4a98db428_del complete
Aug 16 20:31:22 user nova-compute[72894]: INFO nova.compute.manager [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 20:31:22 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:31:22 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:31:22 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:31:22 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:31:22 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Took 0.90 seconds to deallocate network for instance.
Aug 16 20:31:22 user nova-compute[72894]: DEBUG nova.compute.manager [req-a61ab765-43ce-4d80-93a4-a3b722de80f3 req-be1219b4-efbf-4d6b-903d-dabf471c6fe4 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-deleted-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:23 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Deleted allocations for instance a8097cb6-3257-4d91-8067-2ad4a98db428
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5a9823a6-aecb-462a-956f-8cf96feebff4 tempest-AttachVolumeTestJSON-1942038190 tempest-AttachVolumeTestJSON-1942038190-project-member] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] Acquiring lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] Lock "a8097cb6-3257-4d91-8067-2ad4a98db428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] No waiting events found dispatching network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:31:23 user nova-compute[72894]: WARNING nova.compute.manager [req-062947a9-e774-41cb-9013-2cc41dac05db req-8832f8f0-a102-44c0-90f0-78a11028e373 service nova] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Received unexpected event network-vif-plugged-450997e7-0be1-4aaf-a78b-e15a8a426261 for instance with vm_state deleted and task_state None.
Aug 16 20:31:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:31:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:33 user nova-compute[72894]: INFO nova.compute.manager [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Terminating instance
Aug 16 20:31:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fd2394cc-c22e-463d-8daf-1dede7942441 req-4ca9e21e-483d-4f7f-ade9-38b0cc7d7470 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-unplugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:31:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Instance destroyed successfully.
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lazy-loading 'resources' on Instance uuid 4c4aa7fe-9139-42de-8005-58da4eb1f132 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977989885',display_name='tempest-ServerStableDeviceRescueTest-server-1977989885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977989885',id=43,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZMr6pNSznnDGIGmSFjzQZdvoa9cDVOWHRhlu/lkgPaqaeYwXZXThOp7cdgYGgL0TXx/5TgqEcfpAmopBN+ErE2TUrvUu4m1trVZfbCJZOxh+T0wDBaPuKqvep4Vr+Rw==',key_name='tempest-keypair-54417522',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:28:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c093167d32ce4486a1da4f1688d2a5b8',ramdisk_id='',reservation_id='r-shud9vcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-911931366',owner_user_name='tempest-ServerStableDeviceRescueTest-911931366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86770bea7ddc440b8c1a3e81adb24cc4',uuid=4c4aa7fe-9139-42de-8005-58da4eb1f132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converting VIF {"id": "fcc3370c-0323-4582-b412-16b172e60a4c", "address": "fa:16:3e:51:75:61", "network": {"id": "bcabbf9b-dc28-4b6c-9302-c80c016cc158", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1661842300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c093167d32ce4486a1da4f1688d2a5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc3370c-03", "ovs_interfaceid": "fcc3370c-0323-4582-b412-16b172e60a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG os_vif [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcc3370c-03, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:34 user nova-compute[72894]: INFO os_vif [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:61,bridge_name='br-int',has_traffic_filtering=True,id=fcc3370c-0323-4582-b412-16b172e60a4c,network=Network(bcabbf9b-dc28-4b6c-9302-c80c016cc158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc3370c-03')
Aug 16 20:31:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Deleting instance files /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132_del
Aug 16 20:31:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Deletion of /opt/stack/data/nova/instances/4c4aa7fe-9139-42de-8005-58da4eb1f132_del complete
Aug 16 20:31:34 user nova-compute[72894]: INFO nova.compute.manager [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 16 20:31:34 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:31:34 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-a774a7e2-50fa-41fe-aed5-68e43c7de69a req-48f773d5-3703-4825-8038-241d50bff7f9 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-deleted-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:35 user nova-compute[72894]: INFO nova.compute.manager [req-a774a7e2-50fa-41fe-aed5-68e43c7de69a req-48f773d5-3703-4825-8038-241d50bff7f9 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Neutron deleted interface fcc3370c-0323-4582-b412-16b172e60a4c; detaching it from the instance and deleting it from the info cache
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-a774a7e2-50fa-41fe-aed5-68e43c7de69a req-48f773d5-3703-4825-8038-241d50bff7f9 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:31:35 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Took 0.81 seconds to deallocate network for instance.
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-a774a7e2-50fa-41fe-aed5-68e43c7de69a req-48f773d5-3703-4825-8038-241d50bff7f9 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Detach interface failed, port_id=fcc3370c-0323-4582-b412-16b172e60a4c, reason: Instance 4c4aa7fe-9139-42de-8005-58da4eb1f132 could not be found. {{(pid=72894) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:31:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.101s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:35 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Deleted allocations for instance 4c4aa7fe-9139-42de-8005-58da4eb1f132
Aug 16 20:31:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c2eaa6ab-09a4-4097-90c1-5f77c1acb22d tempest-ServerStableDeviceRescueTest-911931366 tempest-ServerStableDeviceRescueTest-911931366-project-member] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:31:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] Acquiring lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:31:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:31:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] Lock "4c4aa7fe-9139-42de-8005-58da4eb1f132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:31:36 user nova-compute[72894]: DEBUG nova.compute.manager [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] No waiting events found dispatching network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:31:36 user nova-compute[72894]: WARNING nova.compute.manager [req-196888b7-7ea1-4ffd-a27a-6665c0c74158 req-3c415b96-ca80-4c18-bdcb-5ce893b87923 service nova] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Received unexpected event network-vif-plugged-fcc3370c-0323-4582-b412-16b172e60a4c for instance with vm_state deleted and task_state None.
Aug 16 20:31:36 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217881.876815, a8097cb6-3257-4d91-8067-2ad4a98db428 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:31:36 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] VM Stopped (Lifecycle Event)
Aug 16 20:31:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5d6298e0-2d87-4fdf-af4a-d4837c6a8ed3 None None] [instance: a8097cb6-3257-4d91-8067-2ad4a98db428] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:31:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:31:49 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692217894.5256352, 4c4aa7fe-9139-42de-8005-58da4eb1f132 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:31:49 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] VM Stopped (Lifecycle Event)
Aug 16 20:31:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bd1ce8f8-fb70-45e9-a919-dd56260a1b95 None None] [instance: 4c4aa7fe-9139-42de-8005-58da4eb1f132] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:31:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:52 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:31:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:31:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:32:05 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:05 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=24.2584228515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:32:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:32:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:32:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:32:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:44 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:32:44 user nova-compute[72894]: INFO nova.compute.claims [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Claim successful on node user
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:32:45 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.policy [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b38af20e569843e59b979146b428d0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b2ae7a9674dfbab608bfe4a5472d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:32:45 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Creating image(s)
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "/opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "/opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "/opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk 1073741824" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Successfully created port: cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:32:45 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Cannot resize image /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'migration_context' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Ensure instance console log exists: /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Successfully updated port: cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-changed-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.compute.manager [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Refreshing instance network info cache due to event network-changed-cc51564e-97bb-454c-bfe0-e89333e37910. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:32:46 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.neutron [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Instance network_info: |[{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Refreshing network info cache for port cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Start _get_guest_xml network_info=[{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:32:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:47 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949961094',display_name='tempest-ServersNegativeTestJSON-server-949961094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949961094',id=45,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-hev03mhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:32:45Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=91679ff4-3b94-4cdc-b320-cf4df9daf00d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'pci_devices' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:32:47 user nova-compute[72894]:   <uuid>91679ff4-3b94-4cdc-b320-cf4df9daf00d</uuid>
Aug 16 20:32:47 user nova-compute[72894]:   <name>instance-0000002d</name>
Aug 16 20:32:47 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:32:47 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:32:47 user nova-compute[72894]:   <metadata>
Aug 16 20:32:47 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:32:47 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:name>tempest-ServersNegativeTestJSON-server-949961094</nova:name>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:32:47</nova:creationTime>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:32:47 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:32:47 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:owner>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:user uuid="b38af20e569843e59b979146b428d0c8">tempest-ServersNegativeTestJSON-1085938696-project-member</nova:user>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:project uuid="d91b2ae7a9674dfbab608bfe4a5472d8">tempest-ServersNegativeTestJSON-1085938696</nova:project>
Aug 16 20:32:47 user nova-compute[72894]:       </nova:owner>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:32:47 user nova-compute[72894]:       <nova:ports>
Aug 16 20:32:47 user nova-compute[72894]:         <nova:port uuid="cc51564e-97bb-454c-bfe0-e89333e37910">
Aug 16 20:32:47 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 20:32:47 user nova-compute[72894]:         </nova:port>
Aug 16 20:32:47 user nova-compute[72894]:       </nova:ports>
Aug 16 20:32:47 user nova-compute[72894]:     </nova:instance>
Aug 16 20:32:47 user nova-compute[72894]:   </metadata>
Aug 16 20:32:47 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:32:47 user nova-compute[72894]:     <system>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="serial">91679ff4-3b94-4cdc-b320-cf4df9daf00d</entry>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="uuid">91679ff4-3b94-4cdc-b320-cf4df9daf00d</entry>
Aug 16 20:32:47 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:32:47 user nova-compute[72894]:     </system>
Aug 16 20:32:47 user nova-compute[72894]:   </sysinfo>
Aug 16 20:32:47 user nova-compute[72894]:   <os>
Aug 16 20:32:47 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:32:47 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:32:47 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:32:47 user nova-compute[72894]:   </os>
Aug 16 20:32:47 user nova-compute[72894]:   <features>
Aug 16 20:32:47 user nova-compute[72894]:     <acpi/>
Aug 16 20:32:47 user nova-compute[72894]:     <apic/>
Aug 16 20:32:47 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:32:47 user nova-compute[72894]:   </features>
Aug 16 20:32:47 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:32:47 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:32:47 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:32:47 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:32:47 user nova-compute[72894]:   </clock>
Aug 16 20:32:47 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:32:47 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:32:47 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:32:47 user nova-compute[72894]:   </cpu>
Aug 16 20:32:47 user nova-compute[72894]:   <devices>
Aug 16 20:32:47 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:32:47 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:32:47 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk"/>
Aug 16 20:32:47 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:32:47 user nova-compute[72894]:     </disk>
Aug 16 20:32:47 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:32:47 user nova-compute[72894]:       <mac address="fa:16:3e:cd:88:db"/>
Aug 16 20:32:47 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:32:47 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:32:47 user nova-compute[72894]:       <target dev="tapcc51564e-97"/>
Aug 16 20:32:47 user nova-compute[72894]:     </interface>
Aug 16 20:32:47 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:32:47 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/console.log" append="off"/>
Aug 16 20:32:47 user nova-compute[72894]:     </serial>
Aug 16 20:32:47 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:32:47 user nova-compute[72894]:     <video>
Aug 16 20:32:47 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:32:47 user nova-compute[72894]:     </video>
Aug 16 20:32:47 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:32:47 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:32:47 user nova-compute[72894]:     </rng>
Aug 16 20:32:47 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:32:47 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:32:47 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:32:47 user nova-compute[72894]:     </memballoon>
Aug 16 20:32:47 user nova-compute[72894]:   </devices>
Aug 16 20:32:47 user nova-compute[72894]: </domain>
Aug 16 20:32:47 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949961094',display_name='tempest-ServersNegativeTestJSON-server-949961094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949961094',id=45,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-hev03mhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:32:45Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=91679ff4-3b94-4cdc-b320-cf4df9daf00d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG os_vif [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc51564e-97, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc51564e-97, col_values=(('external_ids', {'iface-id': 'cc51564e-97bb-454c-bfe0-e89333e37910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:88:db', 'vm-uuid': '91679ff4-3b94-4cdc-b320-cf4df9daf00d'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:47 user nova-compute[72894]: INFO os_vif [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97')
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] No VIF found with MAC fa:16:3e:cd:88:db, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updated VIF entry in instance network info cache for port cc51564e-97bb-454c-bfe0-e89333e37910. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG nova.network.neutron [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:32:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-22628153-7424-46bd-ac23-01e054eb81d0 req-8278e0ea-0eb8-4980-949b-00ac231a8e5b service nova] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:32:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:49 user nova-compute[72894]: DEBUG nova.compute.manager [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] No waiting events found dispatching network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:32:49 user nova-compute[72894]: WARNING nova.compute.manager [req-7136dc67-14c0-4e34-9843-d152abfdac2c req-75b88127-440d-4fd4-87ed-57b9308e03c2 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received unexpected event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 for instance with vm_state building and task_state spawning.
Aug 16 20:32:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217970.8212743, 91679ff4-3b94-4cdc-b320-cf4df9daf00d => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] VM Resumed (Lifecycle Event)
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Instance spawned successfully.
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217970.823055, 91679ff4-3b94-4cdc-b320-cf4df9daf00d => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] VM Started (Lifecycle Event)
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:32:50 user nova-compute[72894]: INFO nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 16 20:32:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:51 user nova-compute[72894]: INFO nova.compute.manager [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Took 6.14 seconds to build instance.
Aug 16 20:32:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fdbe5496-82f1-4467-8cc0-808c09f73e36 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.253s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:51 user nova-compute[72894]: DEBUG nova.compute.manager [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] No waiting events found dispatching network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:32:51 user nova-compute[72894]: WARNING nova.compute.manager [req-89584822-9df5-4550-9d36-a10222466aa7 req-e335bac5-c159-4e7c-bf8e-e47319f9644f service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received unexpected event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 for instance with vm_state active and task_state None.
Aug 16 20:32:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:53 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:32:53 user nova-compute[72894]: INFO nova.compute.claims [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Claim successful on node user
Aug 16 20:32:53 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:32:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.policy [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47688eefc16243728ca8f89e4d7dc8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06017cd5904bd7b841d9626a0d10ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:32:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Creating image(s)
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "/opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk 1073741824" returned: 0 in 0.062s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Successfully created port: 749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Cannot resize image /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'migration_context' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Ensure instance console log exists: /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Successfully updated port: 749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquired lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-changed-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.compute.manager [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Refreshing instance network info cache due to event network-changed-749537db-4ffc-409a-890d-a8b81b8ac4cc. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] Acquiring lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:32:55 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.neutron [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Releasing lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Instance network_info: |[{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] Acquired lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.neutron [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Refreshing network info cache for port 749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Start _get_guest_xml network_info=[{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:32:56 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:56 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1486447855',display_name='tempest-AttachVolumeNegativeTest-server-1486447855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1486447855',id=46,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTmqjEZD/LaUWxxiYNgv3cqu8hKsQYoIdqLA2so8mQxTh7OvZMZmFZjoW/wus5zxb6qUXlA1R+pOszKCIA6YRiyY3cPVgp3McuNZD4DDpzJEO98tznsl1rpNBKrvRLnzw==',key_name='tempest-keypair-2014999549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-aa2rtegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:32:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=326f913d-c236-4ae1-8bf7-49ebe68f21df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'pci_devices' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:32:56 user nova-compute[72894]:   <uuid>326f913d-c236-4ae1-8bf7-49ebe68f21df</uuid>
Aug 16 20:32:56 user nova-compute[72894]:   <name>instance-0000002e</name>
Aug 16 20:32:56 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:32:56 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:32:56 user nova-compute[72894]:   <metadata>
Aug 16 20:32:56 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:32:56 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1486447855</nova:name>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:32:56</nova:creationTime>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:32:56 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:32:56 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:owner>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:user uuid="47688eefc16243728ca8f89e4d7dc8e3">tempest-AttachVolumeNegativeTest-1791980769-project-member</nova:user>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:project uuid="1c06017cd5904bd7b841d9626a0d10ae">tempest-AttachVolumeNegativeTest-1791980769</nova:project>
Aug 16 20:32:56 user nova-compute[72894]:       </nova:owner>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:32:56 user nova-compute[72894]:       <nova:ports>
Aug 16 20:32:56 user nova-compute[72894]:         <nova:port uuid="749537db-4ffc-409a-890d-a8b81b8ac4cc">
Aug 16 20:32:56 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 20:32:56 user nova-compute[72894]:         </nova:port>
Aug 16 20:32:56 user nova-compute[72894]:       </nova:ports>
Aug 16 20:32:56 user nova-compute[72894]:     </nova:instance>
Aug 16 20:32:56 user nova-compute[72894]:   </metadata>
Aug 16 20:32:56 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:32:56 user nova-compute[72894]:     <system>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="serial">326f913d-c236-4ae1-8bf7-49ebe68f21df</entry>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="uuid">326f913d-c236-4ae1-8bf7-49ebe68f21df</entry>
Aug 16 20:32:56 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:32:56 user nova-compute[72894]:     </system>
Aug 16 20:32:56 user nova-compute[72894]:   </sysinfo>
Aug 16 20:32:56 user nova-compute[72894]:   <os>
Aug 16 20:32:56 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:32:56 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:32:56 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:32:56 user nova-compute[72894]:   </os>
Aug 16 20:32:56 user nova-compute[72894]:   <features>
Aug 16 20:32:56 user nova-compute[72894]:     <acpi/>
Aug 16 20:32:56 user nova-compute[72894]:     <apic/>
Aug 16 20:32:56 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:32:56 user nova-compute[72894]:   </features>
Aug 16 20:32:56 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:32:56 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:32:56 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:32:56 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:32:56 user nova-compute[72894]:   </clock>
Aug 16 20:32:56 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:32:56 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:32:56 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:32:56 user nova-compute[72894]:   </cpu>
Aug 16 20:32:56 user nova-compute[72894]:   <devices>
Aug 16 20:32:56 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:32:56 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:32:56 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk"/>
Aug 16 20:32:56 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:32:56 user nova-compute[72894]:     </disk>
Aug 16 20:32:56 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:32:56 user nova-compute[72894]:       <mac address="fa:16:3e:44:83:10"/>
Aug 16 20:32:56 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:32:56 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:32:56 user nova-compute[72894]:       <target dev="tap749537db-4f"/>
Aug 16 20:32:56 user nova-compute[72894]:     </interface>
Aug 16 20:32:56 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:32:56 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/console.log" append="off"/>
Aug 16 20:32:56 user nova-compute[72894]:     </serial>
Aug 16 20:32:56 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:32:56 user nova-compute[72894]:     <video>
Aug 16 20:32:56 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:32:56 user nova-compute[72894]:     </video>
Aug 16 20:32:56 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:32:56 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:32:56 user nova-compute[72894]:     </rng>
Aug 16 20:32:56 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:32:56 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:32:56 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:32:56 user nova-compute[72894]:     </memballoon>
Aug 16 20:32:56 user nova-compute[72894]:   </devices>
Aug 16 20:32:56 user nova-compute[72894]: </domain>
Aug 16 20:32:56 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1486447855',display_name='tempest-AttachVolumeNegativeTest-server-1486447855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1486447855',id=46,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTmqjEZD/LaUWxxiYNgv3cqu8hKsQYoIdqLA2so8mQxTh7OvZMZmFZjoW/wus5zxb6qUXlA1R+pOszKCIA6YRiyY3cPVgp3McuNZD4DDpzJEO98tznsl1rpNBKrvRLnzw==',key_name='tempest-keypair-2014999549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-aa2rtegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:32:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=326f913d-c236-4ae1-8bf7-49ebe68f21df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG os_vif [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap749537db-4f, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap749537db-4f, col_values=(('external_ids', {'iface-id': '749537db-4ffc-409a-890d-a8b81b8ac4cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:83:10', 'vm-uuid': '326f913d-c236-4ae1-8bf7-49ebe68f21df'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:56 user nova-compute[72894]: INFO os_vif [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f')
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:44:83:10, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.neutron [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updated VIF entry in instance network info cache for port 749537db-4ffc-409a-890d-a8b81b8ac4cc. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG nova.network.neutron [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:32:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e9d78f97-52b4-44a3-a85d-637e0f8b6616 req-7dd5f793-ba01-457b-bace-77ef02d24d06 service nova] Releasing lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] No waiting events found dispatching network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:32:57 user nova-compute[72894]: WARNING nova.compute.manager [req-5a40adc8-38dc-4e5c-9e62-2eab35bb6e26 req-a8307d74-1548-4348-a2a1-634f83efdc3b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received unexpected event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc for instance with vm_state building and task_state spawning.
Aug 16 20:32:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217979.8132756, 326f913d-c236-4ae1-8bf7-49ebe68f21df => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] VM Resumed (Lifecycle Event)
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Instance spawned successfully.
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692217979.8144317, 326f913d-c236-4ae1-8bf7-49ebe68f21df => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] VM Started (Lifecycle Event)
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:32:59 user nova-compute[72894]: INFO nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:32:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] No waiting events found dispatching network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:32:59 user nova-compute[72894]: WARNING nova.compute.manager [req-f1cb8e4a-56da-42e9-8904-2ea68ad54319 req-8c00192a-593b-4019-a8c4-41f385f88d9b service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received unexpected event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc for instance with vm_state building and task_state spawning.
Aug 16 20:33:00 user nova-compute[72894]: INFO nova.compute.manager [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Took 6.25 seconds to build instance.
Aug 16 20:33:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5e051c88-1868-4548-87af-8605f424b53d tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:33:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:33:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:08 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:33:08 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=24.219768524169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:33:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:33:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:11 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:33:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Verify base images {{(pid=72894) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Image id 60545238-42c7-459f-80c0-4238accb7183 yields fingerprint be6b726cf94573444641b4945e2cfab10c2c338f {{(pid=72894) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] image 60545238-42c7-459f-80c0-4238accb7183 at (/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f): checking
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] image 60545238-42c7-459f-80c0-4238accb7183 at (/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f): image is in use {{(pid=72894) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72894) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] 91679ff4-3b94-4cdc-b320-cf4df9daf00d is a valid instance name {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] 91679ff4-3b94-4cdc-b320-cf4df9daf00d has a disk file {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d is backed by be6b726cf94573444641b4945e2cfab10c2c338f {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] 326f913d-c236-4ae1-8bf7-49ebe68f21df is a valid instance name {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] 326f913d-c236-4ae1-8bf7-49ebe68f21df has a disk file {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df is backed by be6b726cf94573444641b4945e2cfab10c2c338f {{(pid=72894) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383
Aug 16 20:33:23 user nova-compute[72894]: WARNING nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Active base files: /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Removable base files: /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6 /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817 /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383 /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57e7861e54fe043684999de7f5c1be8a1756f0bc
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64ef4fdf63e63585bafa3da569d24a446a33c90e
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ecc7796acae77b0c5bb2a9e6e96d5959bba271a6
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4a22d3224b000a0ce93f4e6ec87532a3e410e54a
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/25025f284c96ca8c365419e63fd7498675ff7817
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3653805e5e61791e116eefa28b20428434da992a
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8be5c23fd15af53e2f0254bf6d04b2d7020d6b0d
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7e551d4e363ba833014226eb2c509fd8f46fd383
Aug 16 20:33:23 user nova-compute[72894]: INFO nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bfbc74493d355a9aeec084fd3ab34282a1bee242
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Verification complete {{(pid=72894) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Verify swap images {{(pid=72894) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 20:33:23 user nova-compute[72894]: DEBUG nova.virt.libvirt.imagecache [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Verify ephemeral images {{(pid=72894) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 20:33:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:33:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:33:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:33:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:55 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:33:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:33:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:33:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:33:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:34:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:34:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:34:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:34:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:34:10 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=24.189598083496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:34:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:34:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:34:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:34:36 user nova-compute[72894]: INFO nova.compute.claims [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Claim successful on node user
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:34:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.policy [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b38af20e569843e59b979146b428d0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b2ae7a9674dfbab608bfe4a5472d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:34:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Creating image(s)
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "/opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "/opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "/opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.199s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.211s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk 1073741824" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.412s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Cannot resize image /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.objects.instance [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'migration_context' on Instance uuid 257c7460-458c-4378-b715-d27e7a737476 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Ensure instance console log exists: /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:37 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Successfully created port: 1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Successfully updated port: 1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquired lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-changed-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Refreshing instance network info cache due to event network-changed-1ac04461-06e3-43be-8fda-718ae9b51574. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] Acquiring lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:34:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Updating instance_info_cache with network_info: [{"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Releasing lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Instance network_info: |[{"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] Acquired lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Refreshing network info cache for port 1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Start _get_guest_xml network_info=[{"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:34:39 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:34:39 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-183616817',display_name='tempest-ServersNegativeTestJSON-server-183616817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-183616817',id=47,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-5e0r7233',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:34:37Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=257c7460-458c-4378-b715-d27e7a737476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.objects.instance [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'pci_devices' on Instance uuid 257c7460-458c-4378-b715-d27e7a737476 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:34:39 user nova-compute[72894]:   <uuid>257c7460-458c-4378-b715-d27e7a737476</uuid>
Aug 16 20:34:39 user nova-compute[72894]:   <name>instance-0000002f</name>
Aug 16 20:34:39 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:34:39 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:34:39 user nova-compute[72894]:   <metadata>
Aug 16 20:34:39 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:34:39 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:name>tempest-ServersNegativeTestJSON-server-183616817</nova:name>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:34:39</nova:creationTime>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:34:39 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:34:39 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:owner>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:user uuid="b38af20e569843e59b979146b428d0c8">tempest-ServersNegativeTestJSON-1085938696-project-member</nova:user>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:project uuid="d91b2ae7a9674dfbab608bfe4a5472d8">tempest-ServersNegativeTestJSON-1085938696</nova:project>
Aug 16 20:34:39 user nova-compute[72894]:       </nova:owner>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:34:39 user nova-compute[72894]:       <nova:ports>
Aug 16 20:34:39 user nova-compute[72894]:         <nova:port uuid="1ac04461-06e3-43be-8fda-718ae9b51574">
Aug 16 20:34:39 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 20:34:39 user nova-compute[72894]:         </nova:port>
Aug 16 20:34:39 user nova-compute[72894]:       </nova:ports>
Aug 16 20:34:39 user nova-compute[72894]:     </nova:instance>
Aug 16 20:34:39 user nova-compute[72894]:   </metadata>
Aug 16 20:34:39 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:34:39 user nova-compute[72894]:     <system>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="serial">257c7460-458c-4378-b715-d27e7a737476</entry>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="uuid">257c7460-458c-4378-b715-d27e7a737476</entry>
Aug 16 20:34:39 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:34:39 user nova-compute[72894]:     </system>
Aug 16 20:34:39 user nova-compute[72894]:   </sysinfo>
Aug 16 20:34:39 user nova-compute[72894]:   <os>
Aug 16 20:34:39 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:34:39 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:34:39 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:34:39 user nova-compute[72894]:   </os>
Aug 16 20:34:39 user nova-compute[72894]:   <features>
Aug 16 20:34:39 user nova-compute[72894]:     <acpi/>
Aug 16 20:34:39 user nova-compute[72894]:     <apic/>
Aug 16 20:34:39 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:34:39 user nova-compute[72894]:   </features>
Aug 16 20:34:39 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:34:39 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:34:39 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:34:39 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:34:39 user nova-compute[72894]:   </clock>
Aug 16 20:34:39 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:34:39 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:34:39 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:34:39 user nova-compute[72894]:   </cpu>
Aug 16 20:34:39 user nova-compute[72894]:   <devices>
Aug 16 20:34:39 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:34:39 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:34:39 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk"/>
Aug 16 20:34:39 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:34:39 user nova-compute[72894]:     </disk>
Aug 16 20:34:39 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:34:39 user nova-compute[72894]:       <mac address="fa:16:3e:cb:d3:80"/>
Aug 16 20:34:39 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:34:39 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:34:39 user nova-compute[72894]:       <target dev="tap1ac04461-06"/>
Aug 16 20:34:39 user nova-compute[72894]:     </interface>
Aug 16 20:34:39 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:34:39 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/console.log" append="off"/>
Aug 16 20:34:39 user nova-compute[72894]:     </serial>
Aug 16 20:34:39 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:34:39 user nova-compute[72894]:     <video>
Aug 16 20:34:39 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:34:39 user nova-compute[72894]:     </video>
Aug 16 20:34:39 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:34:39 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:34:39 user nova-compute[72894]:     </rng>
Aug 16 20:34:39 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:34:39 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:34:39 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:34:39 user nova-compute[72894]:     </memballoon>
Aug 16 20:34:39 user nova-compute[72894]:   </devices>
Aug 16 20:34:39 user nova-compute[72894]: </domain>
Aug 16 20:34:39 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-183616817',display_name='tempest-ServersNegativeTestJSON-server-183616817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-183616817',id=47,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-5e0r7233',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:34:37Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=257c7460-458c-4378-b715-d27e7a737476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG os_vif [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ac04461-06, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ac04461-06, col_values=(('external_ids', {'iface-id': '1ac04461-06e3-43be-8fda-718ae9b51574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:d3:80', 'vm-uuid': '257c7460-458c-4378-b715-d27e7a737476'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:39 user nova-compute[72894]: INFO os_vif [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06')
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] No VIF found with MAC fa:16:3e:cb:d3:80, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Updated VIF entry in instance network info cache for port 1ac04461-06e3-43be-8fda-718ae9b51574. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Updating instance_info_cache with network_info: [{"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:34:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa7d2c7c-9c57-40df-8cfd-ca377ad24415 req-36ebe7f8-205e-4a3f-b857-6a6d5748a907 service nova] Releasing lock "refresh_cache-257c7460-458c-4378-b715-d27e7a737476" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] No waiting events found dispatching network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:34:40 user nova-compute[72894]: WARNING nova.compute.manager [req-272f3bc3-b330-4f50-ba3f-85f32829df84 req-785c27a7-bd9c-40c6-9b64-419f9413f069 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received unexpected event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 for instance with vm_state building and task_state spawning.
Aug 16 20:34:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218082.5873468, 257c7460-458c-4378-b715-d27e7a737476 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] VM Resumed (Lifecycle Event)
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] Instance spawned successfully.
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218082.5891635, 257c7460-458c-4378-b715-d27e7a737476 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] VM Started (Lifecycle Event)
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:42 user nova-compute[72894]: DEBUG nova.compute.manager [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] No waiting events found dispatching network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:34:42 user nova-compute[72894]: WARNING nova.compute.manager [req-8d565374-e505-4131-a1eb-335fe79d7768 req-59dc1a6f-0b52-4fa7-a636-8117d9fdfb3d service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received unexpected event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 for instance with vm_state building and task_state spawning.
Aug 16 20:34:42 user nova-compute[72894]: INFO nova.compute.manager [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Took 6.45 seconds to build instance.
Aug 16 20:34:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-14a36167-3a0d-4583-9e18-ef1f3aa53797 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-changed-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG nova.compute.manager [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Refreshing instance network info cache due to event network-changed-749537db-4ffc-409a-890d-a8b81b8ac4cc. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] Acquiring lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] Acquired lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG nova.network.neutron [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Refreshing network info cache for port 749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:34:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:45 user nova-compute[72894]: DEBUG nova.network.neutron [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updated VIF entry in instance network info cache for port 749537db-4ffc-409a-890d-a8b81b8ac4cc. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:34:45 user nova-compute[72894]: DEBUG nova.network.neutron [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:34:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2663fbec-d4d2-448a-8507-00c61aac37b6 req-de317ae1-9c3e-44d1-aaeb-c004b31009d8 service nova] Releasing lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 257c7460-458c-4378-b715-d27e7a737476 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "257c7460-458c-4378-b715-d27e7a737476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "257c7460-458c-4378-b715-d27e7a737476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:34:49 user nova-compute[72894]: INFO nova.compute.manager [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Attaching volume 6d6f1baa-461c-4a69-8e61-a258ea29004e to /dev/vdb
Aug 16 20:34:49 user nova-compute[72894]: DEBUG os_brick.utils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df218639-8bf2-409a-b7a2-4cb2d3e4b96e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e0c6b6-a5a2-4dd8-8d7b-2c9a8e0fd83e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a1813-6be5-487c-ba6e-cbc9b77f658d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf788c-8b4d-41bc-b345-bc5d2c536e37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:34:49 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:34:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8eede8-406f-452c-b139-548f3fbf2919]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:34:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:34:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:34:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:34:50 user nova-compute[72894]: DEBUG os_brick.utils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:34:50 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating existing volume attachment record: b69932bd-d388-43d0-8212-4a9c5d47a780 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:34:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfLVlatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:34:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:34:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:34:59 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:34:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:34:59 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:34:59 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:34:59 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f6f804-b5fc-4cc4-af80-961eda756f12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:35:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[529c3cef-0bdb-4270-b995-7f8741e35203]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e] added
Aug 16 20:35:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a6f23-fb24-490c-a173-de79b563d3e7]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[651dce8c-5333-4a48-9fd1-6f35ecf3cf22]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfLVlatD {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfLVlatD" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[982eed04-7d75-408f-9e3c-7d53163d5227]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfLVlatD'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f81082-a143-4c13-a3b7-e1e9c1937b43]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d717f7e-117a-4457-9518-47fb6555a6fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:35:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:35:00 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:35:00 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:35:00 user nova-compute[72894]: 
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa99ab-e459-4ce6-9f7d-f72e855fdce2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260]
Aug 16 20:35:00 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260] successful.
Aug 16 20:35:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b59757-868a-46bb-bc62-5877ce4466b2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84ddf15-75e1-4290-a9b3-cad71e73b111]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)
Aug 16 20:35:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)
Aug 16 20:35:00 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8731349e-580d-4732-b70d-908f3e9ccad7]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfLVlatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:35:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26161316534633362', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161316534633362', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:35:01 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:35:01 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:35:01 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:35:01 user nova-compute[72894]:   <serial>6d6f1baa-461c-4a69-8e61-a258ea29004e</serial>
Aug 16 20:35:01 user nova-compute[72894]: </disk>
Aug 16 20:35:01 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:44:83:10, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:35:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5ab6c40c-6da5-4d53-b300-91e23abdc908 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.033s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:05 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:35:05 user nova-compute[72894]: INFO nova.compute.claims [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Claim successful on node user
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:35:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.policy [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47688eefc16243728ca8f89e4d7dc8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06017cd5904bd7b841d9626a0d10ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:35:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Creating image(s)
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "/opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk 1073741824" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Successfully created port: b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Cannot resize image /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'migration_context' on Instance uuid 02ade6ec-94da-419e-a544-47ed42af27a8 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Ensure instance console log exists: /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Successfully updated port: b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquired lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-changed-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG nova.compute.manager [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Refreshing instance network info cache due to event network-changed-b8e5cda9-66f7-4624-8c98-400f5b0cde99. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:35:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] Acquiring lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updating instance_info_cache with network_info: [{"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Releasing lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Instance network_info: |[{"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] Acquired lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Refreshing network info cache for port b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Start _get_guest_xml network_info=[{"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:35:08 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:35:08 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Skipping network cache update for instance because it is Building. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624766546',display_name='tempest-AttachVolumeNegativeTest-server-624766546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624766546',id=48,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYJHglJr7FCO6lLSwinaQ+CDhMSCCgvab/h6KmPmHGP1vUC/SQeyq6i0QCUamHS7QjF7YA9bCWEJs2egXQGgOVp0A+XTJ+3znObQZ5DZq8Le17jg3oB0Q/azfw//JAH+A==',key_name='tempest-keypair-368441584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-0kddhqiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=02ade6ec-94da-419e-a544-47ed42af27a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'pci_devices' on Instance uuid 02ade6ec-94da-419e-a544-47ed42af27a8 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:35:08 user nova-compute[72894]:   <uuid>02ade6ec-94da-419e-a544-47ed42af27a8</uuid>
Aug 16 20:35:08 user nova-compute[72894]:   <name>instance-00000030</name>
Aug 16 20:35:08 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:35:08 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:35:08 user nova-compute[72894]:   <metadata>
Aug 16 20:35:08 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:35:08 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeNegativeTest-server-624766546</nova:name>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:35:08</nova:creationTime>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:35:08 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:35:08 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:owner>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:user uuid="47688eefc16243728ca8f89e4d7dc8e3">tempest-AttachVolumeNegativeTest-1791980769-project-member</nova:user>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:project uuid="1c06017cd5904bd7b841d9626a0d10ae">tempest-AttachVolumeNegativeTest-1791980769</nova:project>
Aug 16 20:35:08 user nova-compute[72894]:       </nova:owner>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:35:08 user nova-compute[72894]:       <nova:ports>
Aug 16 20:35:08 user nova-compute[72894]:         <nova:port uuid="b8e5cda9-66f7-4624-8c98-400f5b0cde99">
Aug 16 20:35:08 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 20:35:08 user nova-compute[72894]:         </nova:port>
Aug 16 20:35:08 user nova-compute[72894]:       </nova:ports>
Aug 16 20:35:08 user nova-compute[72894]:     </nova:instance>
Aug 16 20:35:08 user nova-compute[72894]:   </metadata>
Aug 16 20:35:08 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:35:08 user nova-compute[72894]:     <system>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="serial">02ade6ec-94da-419e-a544-47ed42af27a8</entry>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="uuid">02ade6ec-94da-419e-a544-47ed42af27a8</entry>
Aug 16 20:35:08 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:35:08 user nova-compute[72894]:     </system>
Aug 16 20:35:08 user nova-compute[72894]:   </sysinfo>
Aug 16 20:35:08 user nova-compute[72894]:   <os>
Aug 16 20:35:08 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:35:08 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:35:08 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:35:08 user nova-compute[72894]:   </os>
Aug 16 20:35:08 user nova-compute[72894]:   <features>
Aug 16 20:35:08 user nova-compute[72894]:     <acpi/>
Aug 16 20:35:08 user nova-compute[72894]:     <apic/>
Aug 16 20:35:08 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:35:08 user nova-compute[72894]:   </features>
Aug 16 20:35:08 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:35:08 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:35:08 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:35:08 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:35:08 user nova-compute[72894]:   </clock>
Aug 16 20:35:08 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:35:08 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:35:08 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:35:08 user nova-compute[72894]:   </cpu>
Aug 16 20:35:08 user nova-compute[72894]:   <devices>
Aug 16 20:35:08 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:35:08 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:35:08 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk"/>
Aug 16 20:35:08 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:35:08 user nova-compute[72894]:     </disk>
Aug 16 20:35:08 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:35:08 user nova-compute[72894]:       <mac address="fa:16:3e:71:e5:c5"/>
Aug 16 20:35:08 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:35:08 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:35:08 user nova-compute[72894]:       <target dev="tapb8e5cda9-66"/>
Aug 16 20:35:08 user nova-compute[72894]:     </interface>
Aug 16 20:35:08 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:35:08 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/console.log" append="off"/>
Aug 16 20:35:08 user nova-compute[72894]:     </serial>
Aug 16 20:35:08 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:35:08 user nova-compute[72894]:     <video>
Aug 16 20:35:08 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:35:08 user nova-compute[72894]:     </video>
Aug 16 20:35:08 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:35:08 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:35:08 user nova-compute[72894]:     </rng>
Aug 16 20:35:08 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:35:08 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:35:08 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:35:08 user nova-compute[72894]:     </memballoon>
Aug 16 20:35:08 user nova-compute[72894]:   </devices>
Aug 16 20:35:08 user nova-compute[72894]: </domain>
Aug 16 20:35:08 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624766546',display_name='tempest-AttachVolumeNegativeTest-server-624766546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624766546',id=48,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYJHglJr7FCO6lLSwinaQ+CDhMSCCgvab/h6KmPmHGP1vUC/SQeyq6i0QCUamHS7QjF7YA9bCWEJs2egXQGgOVp0A+XTJ+3znObQZ5DZq8Le17jg3oB0Q/azfw//JAH+A==',key_name='tempest-keypair-368441584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-0kddhqiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=02ade6ec-94da-419e-a544-47ed42af27a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG os_vif [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8e5cda9-66, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8e5cda9-66, col_values=(('external_ids', {'iface-id': 'b8e5cda9-66f7-4624-8c98-400f5b0cde99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:e5:c5', 'vm-uuid': '02ade6ec-94da-419e-a544-47ed42af27a8'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:08 user nova-compute[72894]: INFO os_vif [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66')
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:71:e5:c5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updated VIF entry in instance network info cache for port b8e5cda9-66f7-4624-8c98-400f5b0cde99. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updating instance_info_cache with network_info: [{"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0854a9c2-4ac5-4c18-a667-87cc173c8484 req-e2ec0858-2800-45a5-b5ad-61e8b301496a service nova] Releasing lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:35:08 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:35:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] No waiting events found dispatching network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:35:10 user nova-compute[72894]: WARNING nova.compute.manager [req-3f7950d6-a699-4f77-be65-f476d0563efa req-da439819-d117-4aa3-a328-e9ee3341ebf9 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received unexpected event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 for instance with vm_state building and task_state spawning.
Aug 16 20:35:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218111.944141, 02ade6ec-94da-419e-a544-47ed42af27a8 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:35:11 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] VM Resumed (Lifecycle Event)
Aug 16 20:35:11 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:35:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] No waiting events found dispatching network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:35:12 user nova-compute[72894]: WARNING nova.compute.manager [req-cd690be5-0cdb-402f-8689-1aced564846f req-0bb6addf-21e0-4d76-8aff-68ec1f828d78 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received unexpected event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 for instance with vm_state building and task_state spawning.
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Instance spawned successfully.
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:35:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:35:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=24.159076690673828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218111.954031, 02ade6ec-94da-419e-a544-47ed42af27a8 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] VM Started (Lifecycle Event)
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 257c7460-458c-4378-b715-d27e7a737476 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 02ade6ec-94da-419e-a544-47ed42af27a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:35:12 user nova-compute[72894]: INFO nova.compute.manager [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Took 6.88 seconds to build instance.
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-358c9997-cebe-451a-85f2-f8cb29f2165e tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:35:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:35:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:35:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:35:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:35:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [{"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-326f913d-c236-4ae1-8bf7-49ebe68f21df" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:36:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:36:12 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:36:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=24.130184173583984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 257c7460-458c-4378-b715-d27e7a737476 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 02ade6ec-94da-419e-a544-47ed42af27a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:36:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:26 user nova-compute[72894]: INFO nova.compute.manager [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Terminating instance
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-unplugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] No waiting events found dispatching network-vif-unplugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-4525d742-a007-40d5-b6ff-87ff39d265a0 req-80189147-c0b1-45e5-8bbe-64792bde92d1 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-unplugged-1ac04461-06e3-43be-8fda-718ae9b51574 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] Instance destroyed successfully.
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'resources' on Instance uuid 257c7460-458c-4378-b715-d27e7a737476 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-183616817',display_name='tempest-ServersNegativeTestJSON-server-183616817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-183616817',id=47,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-5e0r7233',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:34:43Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=257c7460-458c-4378-b715-d27e7a737476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "1ac04461-06e3-43be-8fda-718ae9b51574", "address": "fa:16:3e:cb:d3:80", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac04461-06", "ovs_interfaceid": "1ac04461-06e3-43be-8fda-718ae9b51574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG os_vif [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ac04461-06, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:26 user nova-compute[72894]: INFO os_vif [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d3:80,bridge_name='br-int',has_traffic_filtering=True,id=1ac04461-06e3-43be-8fda-718ae9b51574,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac04461-06')
Aug 16 20:36:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Deleting instance files /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476_del
Aug 16 20:36:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Deletion of /opt/stack/data/nova/instances/257c7460-458c-4378-b715-d27e7a737476_del complete
Aug 16 20:36:27 user nova-compute[72894]: INFO nova.compute.manager [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 257c7460-458c-4378-b715-d27e7a737476] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 16 20:36:27 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:36:27 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] Took 0.55 seconds to deallocate network for instance.
Aug 16 20:36:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-bd513a80-e9a0-4858-8ed5-232ceba9c6fd req-44f20c54-811a-49bd-bb06-a0fa5a663c3e service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-deleted-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:36:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:27 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Deleted allocations for instance 257c7460-458c-4378-b715-d27e7a737476
Aug 16 20:36:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-508ee114-2e3f-4a07-9e7a-a1d3b2978d66 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "257c7460-458c-4378-b715-d27e7a737476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.547s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] Acquiring lock "257c7460-458c-4378-b715-d27e7a737476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] Lock "257c7460-458c-4378-b715-d27e7a737476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] No waiting events found dispatching network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:36:28 user nova-compute[72894]: WARNING nova.compute.manager [req-ca4392ef-0535-4361-a2c8-a383e66f21e2 req-bc315afe-a91c-4a2e-b8fc-5af3554d5847 service nova] [instance: 257c7460-458c-4378-b715-d27e7a737476] Received unexpected event network-vif-plugged-1ac04461-06e3-43be-8fda-718ae9b51574 for instance with vm_state deleted and task_state None.
Aug 16 20:36:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:36:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:41 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218186.9528182, 257c7460-458c-4378-b715-d27e7a737476 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:36:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 257c7460-458c-4378-b715-d27e7a737476] VM Stopped (Lifecycle Event)
Aug 16 20:36:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-b940509b-3018-4685-bb80-a3720ddbfe46 None None] [instance: 257c7460-458c-4378-b715-d27e7a737476] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:36:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-changed-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.compute.manager [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Refreshing instance network info cache due to event network-changed-b8e5cda9-66f7-4624-8c98-400f5b0cde99. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] Acquiring lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] Acquired lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Refreshing network info cache for port b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:57 user nova-compute[72894]: INFO nova.compute.manager [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Terminating instance
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updated VIF entry in instance network info cache for port b8e5cda9-66f7-4624-8c98-400f5b0cde99. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG nova.network.neutron [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updating instance_info_cache with network_info: [{"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c2c5e2f7-be5e-4d65-94b4-a8b916cf67a1 req-1853c5bc-7bd2-4ef9-a495-4ee9c4f4ebd7 service nova] Releasing lock "refresh_cache-02ade6ec-94da-419e-a544-47ed42af27a8" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-unplugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] No waiting events found dispatching network-vif-unplugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.compute.manager [req-3dd3893f-f5ca-4094-957f-3322ea1e811f req-a7c6e8ad-0084-4109-8c17-d2359adaa643 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-unplugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:36:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Instance destroyed successfully.
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'resources' on Instance uuid 02ade6ec-94da-419e-a544-47ed42af27a8 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624766546',display_name='tempest-AttachVolumeNegativeTest-server-624766546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624766546',id=48,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYJHglJr7FCO6lLSwinaQ+CDhMSCCgvab/h6KmPmHGP1vUC/SQeyq6i0QCUamHS7QjF7YA9bCWEJs2egXQGgOVp0A+XTJ+3znObQZ5DZq8Le17jg3oB0Q/azfw//JAH+A==',key_name='tempest-keypair-368441584',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-0kddhqiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=02ade6ec-94da-419e-a544-47ed42af27a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "address": "fa:16:3e:71:e5:c5", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e5cda9-66", "ovs_interfaceid": "b8e5cda9-66f7-4624-8c98-400f5b0cde99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG os_vif [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8e5cda9-66, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:36:58 user nova-compute[72894]: INFO os_vif [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e5:c5,bridge_name='br-int',has_traffic_filtering=True,id=b8e5cda9-66f7-4624-8c98-400f5b0cde99,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e5cda9-66')
Aug 16 20:36:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Deleting instance files /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8_del
Aug 16 20:36:58 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Deletion of /opt/stack/data/nova/instances/02ade6ec-94da-419e-a544-47ed42af27a8_del complete
Aug 16 20:36:58 user nova-compute[72894]: INFO nova.compute.manager [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 16 20:36:58 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:36:58 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:36:59 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Took 0.77 seconds to deallocate network for instance.
Aug 16 20:36:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-edfeaea9-536a-4f6b-9ec4-1e67ef00a93a req-095bef90-f58e-43fc-bc28-fc3d599fa276 service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-deleted-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:59 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Deleted allocations for instance 02ade6ec-94da-419e-a544-47ed42af27a8
Aug 16 20:36:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-312047cc-3720-4339-8f04-06f243e11554 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "02ade6ec-94da-419e-a544-47ed42af27a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:36:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:37:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] Acquiring lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:37:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:37:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] Lock "02ade6ec-94da-419e-a544-47ed42af27a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:37:00 user nova-compute[72894]: DEBUG nova.compute.manager [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] No waiting events found dispatching network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:37:00 user nova-compute[72894]: WARNING nova.compute.manager [req-61b1ac99-3a0c-41ee-8d7d-d2b323600562 req-d40a5fc7-fab4-4e13-a6c5-d52826da252e service nova] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Received unexpected event network-vif-plugged-b8e5cda9-66f7-4624-8c98-400f5b0cde99 for instance with vm_state deleted and task_state None.
Aug 16 20:37:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72894) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 20:37:11 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:37:11 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=24.185020446777344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:37:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:37:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:37:12 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:37:13 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218218.2297091, 02ade6ec-94da-419e-a544-47ed42af27a8 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:37:13 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] VM Stopped (Lifecycle Event)
Aug 16 20:37:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ff6e8fea-0c83-4dac-ad2f-df95d9e05f75 None None] [instance: 02ade6ec-94da-419e-a544-47ed42af27a8] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:37:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:37:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:37:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:37:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:37:49 user nova-compute[72894]: INFO nova.compute.manager [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Detaching volume 6d6f1baa-461c-4a69-8e61-a258ea29004e
Aug 16 20:37:49 user nova-compute[72894]: INFO nova.virt.block_device [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Attempting to driver detach volume 6d6f1baa-461c-4a69-8e61-a258ea29004e from mountpoint /dev/vdb
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Attempting to detach device vdb from instance 326f913d-c236-4ae1-8bf7-49ebe68f21df from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:37:49 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:37:49 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:37:49 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:37:49 user nova-compute[72894]:   <serial>6d6f1baa-461c-4a69-8e61-a258ea29004e</serial>
Aug 16 20:37:49 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:37:49 user nova-compute[72894]: </disk>
Aug 16 20:37:49 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:37:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 326f913d-c236-4ae1-8bf7-49ebe68f21df from the persistent domain config.
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 326f913d-c236-4ae1-8bf7-49ebe68f21df from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:37:49 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:37:49 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:37:49 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:37:49 user nova-compute[72894]:   <serial>6d6f1baa-461c-4a69-8e61-a258ea29004e</serial>
Aug 16 20:37:49 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:37:49 user nova-compute[72894]: </disk>
Aug 16 20:37:49 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692218269.7422767, 326f913d-c236-4ae1-8bf7-49ebe68f21df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:37:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 326f913d-c236-4ae1-8bf7-49ebe68f21df from the live domain config.
Aug 16 20:37:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfLVlatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:37:49 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b1c728-6855-4b9c-88c3-080f081a1bf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f50bf-be7e-49ad-b577-6b066ecbf15a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)
Aug 16 20:37:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e (non-flash)
Aug 16 20:37:49 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4b100d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965ef48-4284-4a18-8070-5a669abfe225]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fdd940-be98-4468-ac5f-387d60c774d5]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6828aaa4-428c-4e5d-8f45-ac0b77abad14]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1519951a-d4b8-4541-aa76-7eb0755890b7]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cdf7f6-e8ad-41b5-8a14-7791e658ed78]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:37:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097cbc4-e314-4e54-a10b-313423348f7f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260]
Aug 16 20:37:50 user nova-compute[72894]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e, portal: 172.16.0.220,3260] successful.
Aug 16 20:37:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6f1baa-461c-4a69-8e61-a258ea29004e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[561159f3-8750-454c-a882-26458898682b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== disconnect_volume: return (271ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:37:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-1f3471fc-c434-49df-9abf-d0de9d062af9 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:37:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:37:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:37:59 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:38:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:38:11 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:38:11 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=24.18427276611328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 326f913d-c236-4ae1-8bf7-49ebe68f21df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:38:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:38:13 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:38:14 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:38:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:38:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:38:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:38:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:38:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:39 user nova-compute[72894]: INFO nova.compute.manager [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Terminating instance
Aug 16 20:38:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-unplugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] No waiting events found dispatching network-vif-unplugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:38:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-b3bf47bd-01c5-4111-937c-bdcb7c335f4d req-179fdcf0-a401-4516-bd4d-0d8274c679aa service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-unplugged-749537db-4ffc-409a-890d-a8b81b8ac4cc for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:38:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Instance destroyed successfully.
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.objects.instance [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'resources' on Instance uuid 326f913d-c236-4ae1-8bf7-49ebe68f21df {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1486447855',display_name='tempest-AttachVolumeNegativeTest-server-1486447855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1486447855',id=46,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTmqjEZD/LaUWxxiYNgv3cqu8hKsQYoIdqLA2so8mQxTh7OvZMZmFZjoW/wus5zxb6qUXlA1R+pOszKCIA6YRiyY3cPVgp3McuNZD4DDpzJEO98tznsl1rpNBKrvRLnzw==',key_name='tempest-keypair-2014999549',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:32:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-aa2rtegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=326f913d-c236-4ae1-8bf7-49ebe68f21df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "address": "fa:16:3e:44:83:10", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749537db-4f", "ovs_interfaceid": "749537db-4ffc-409a-890d-a8b81b8ac4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG os_vif [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap749537db-4f, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:40 user nova-compute[72894]: INFO os_vif [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:83:10,bridge_name='br-int',has_traffic_filtering=True,id=749537db-4ffc-409a-890d-a8b81b8ac4cc,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749537db-4f')
Aug 16 20:38:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Deleting instance files /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df_del
Aug 16 20:38:40 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Deletion of /opt/stack/data/nova/instances/326f913d-c236-4ae1-8bf7-49ebe68f21df_del complete
Aug 16 20:38:40 user nova-compute[72894]: INFO nova.compute.manager [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 20:38:40 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:38:40 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:38:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Took 0.85 seconds to deallocate network for instance.
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:41 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Deleted allocations for instance 326f913d-c236-4ae1-8bf7-49ebe68f21df
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-a65a028c-c32d-4b92-98b6-195e42cb5763 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] Acquiring lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] Lock "326f913d-c236-4ae1-8bf7-49ebe68f21df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] No waiting events found dispatching network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:38:41 user nova-compute[72894]: WARNING nova.compute.manager [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received unexpected event network-vif-plugged-749537db-4ffc-409a-890d-a8b81b8ac4cc for instance with vm_state deleted and task_state None.
Aug 16 20:38:41 user nova-compute[72894]: DEBUG nova.compute.manager [req-18d71079-f9f3-42cb-a271-05b4ba16ff9c req-dbab5e23-47de-441c-9e5e-4c9804e4d4ad service nova] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Received event network-vif-deleted-749537db-4ffc-409a-890d-a8b81b8ac4cc {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:38:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218320.372021, 326f913d-c236-4ae1-8bf7-49ebe68f21df => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:38:55 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] VM Stopped (Lifecycle Event)
Aug 16 20:38:55 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ade7a94e-8c3a-4276-b58b-5e84b6e75231 None None] [instance: 326f913d-c236-4ae1-8bf7-49ebe68f21df] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:38:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:01 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:39:07 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:39:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:12 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:13 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:39:13 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=24.203601837158203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:39:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:39:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:39:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:18 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:39:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:39:33 user nova-compute[72894]: INFO nova.compute.claims [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Claim successful on node user
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:39:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:39:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:39:34 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Creating image(s)
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.policy [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47688eefc16243728ca8f89e4d7dc8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06017cd5904bd7b841d9626a0d10ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk 1073741824" returned: 0 in 0.047s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Successfully created port: b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Cannot resize image /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'migration_context' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Ensure instance console log exists: /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Successfully updated port: b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquired lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-changed-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.compute.manager [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Refreshing instance network info cache due to event network-changed-b6d5961d-fcf2-4c10-af96-a27929a9c730. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] Acquiring lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.neutron [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Releasing lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Instance network_info: |[{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] Acquired lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.neutron [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Refreshing network info cache for port b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Start _get_guest_xml network_info=[{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:39:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:39:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-28217786',display_name='tempest-AttachVolumeNegativeTest-server-28217786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-28217786',id=49,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEfi3UPkOYMK73p4rngpePVYU8kfrLOOk547QNWmpnGEAUQarCLOjKwGQL81flqpWshVL8Bm5aARnYtJWcFTprSX7PutbwqoX8kR2t35PrjYXVbLUNzjLyPzcklqqquZQ==',key_name='tempest-keypair-1480727313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-td03bg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=4ff5cfb8-c49d-40c9-832c-0d08d4ba8097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:39:35 user nova-compute[72894]:   <uuid>4ff5cfb8-c49d-40c9-832c-0d08d4ba8097</uuid>
Aug 16 20:39:35 user nova-compute[72894]:   <name>instance-00000031</name>
Aug 16 20:39:35 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:39:35 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:39:35 user nova-compute[72894]:   <metadata>
Aug 16 20:39:35 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:39:35 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeNegativeTest-server-28217786</nova:name>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:39:35</nova:creationTime>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:39:35 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:39:35 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:owner>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:user uuid="47688eefc16243728ca8f89e4d7dc8e3">tempest-AttachVolumeNegativeTest-1791980769-project-member</nova:user>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:project uuid="1c06017cd5904bd7b841d9626a0d10ae">tempest-AttachVolumeNegativeTest-1791980769</nova:project>
Aug 16 20:39:35 user nova-compute[72894]:       </nova:owner>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:39:35 user nova-compute[72894]:       <nova:ports>
Aug 16 20:39:35 user nova-compute[72894]:         <nova:port uuid="b6d5961d-fcf2-4c10-af96-a27929a9c730">
Aug 16 20:39:35 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 20:39:35 user nova-compute[72894]:         </nova:port>
Aug 16 20:39:35 user nova-compute[72894]:       </nova:ports>
Aug 16 20:39:35 user nova-compute[72894]:     </nova:instance>
Aug 16 20:39:35 user nova-compute[72894]:   </metadata>
Aug 16 20:39:35 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:39:35 user nova-compute[72894]:     <system>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="serial">4ff5cfb8-c49d-40c9-832c-0d08d4ba8097</entry>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="uuid">4ff5cfb8-c49d-40c9-832c-0d08d4ba8097</entry>
Aug 16 20:39:35 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:39:35 user nova-compute[72894]:     </system>
Aug 16 20:39:35 user nova-compute[72894]:   </sysinfo>
Aug 16 20:39:35 user nova-compute[72894]:   <os>
Aug 16 20:39:35 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:39:35 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:39:35 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:39:35 user nova-compute[72894]:   </os>
Aug 16 20:39:35 user nova-compute[72894]:   <features>
Aug 16 20:39:35 user nova-compute[72894]:     <acpi/>
Aug 16 20:39:35 user nova-compute[72894]:     <apic/>
Aug 16 20:39:35 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:39:35 user nova-compute[72894]:   </features>
Aug 16 20:39:35 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:39:35 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:39:35 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:39:35 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:39:35 user nova-compute[72894]:   </clock>
Aug 16 20:39:35 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:39:35 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:39:35 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:39:35 user nova-compute[72894]:   </cpu>
Aug 16 20:39:35 user nova-compute[72894]:   <devices>
Aug 16 20:39:35 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:39:35 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:39:35 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk"/>
Aug 16 20:39:35 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:39:35 user nova-compute[72894]:     </disk>
Aug 16 20:39:35 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:39:35 user nova-compute[72894]:       <mac address="fa:16:3e:07:8b:0c"/>
Aug 16 20:39:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:39:35 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:39:35 user nova-compute[72894]:       <target dev="tapb6d5961d-fc"/>
Aug 16 20:39:35 user nova-compute[72894]:     </interface>
Aug 16 20:39:35 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:39:35 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/console.log" append="off"/>
Aug 16 20:39:35 user nova-compute[72894]:     </serial>
Aug 16 20:39:35 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:39:35 user nova-compute[72894]:     <video>
Aug 16 20:39:35 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:39:35 user nova-compute[72894]:     </video>
Aug 16 20:39:35 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:39:35 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:39:35 user nova-compute[72894]:     </rng>
Aug 16 20:39:35 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:39:35 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:39:35 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:39:35 user nova-compute[72894]:     </memballoon>
Aug 16 20:39:35 user nova-compute[72894]:   </devices>
Aug 16 20:39:35 user nova-compute[72894]: </domain>
Aug 16 20:39:35 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-28217786',display_name='tempest-AttachVolumeNegativeTest-server-28217786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-28217786',id=49,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEfi3UPkOYMK73p4rngpePVYU8kfrLOOk547QNWmpnGEAUQarCLOjKwGQL81flqpWshVL8Bm5aARnYtJWcFTprSX7PutbwqoX8kR2t35PrjYXVbLUNzjLyPzcklqqquZQ==',key_name='tempest-keypair-1480727313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-td03bg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=4ff5cfb8-c49d-40c9-832c-0d08d4ba8097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG os_vif [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6d5961d-fc, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6d5961d-fc, col_values=(('external_ids', {'iface-id': 'b6d5961d-fcf2-4c10-af96-a27929a9c730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:8b:0c', 'vm-uuid': '4ff5cfb8-c49d-40c9-832c-0d08d4ba8097'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:35 user nova-compute[72894]: INFO os_vif [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc')
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:39:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:07:8b:0c, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:39:36 user nova-compute[72894]: DEBUG nova.network.neutron [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updated VIF entry in instance network info cache for port b6d5961d-fcf2-4c10-af96-a27929a9c730. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:39:36 user nova-compute[72894]: DEBUG nova.network.neutron [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:39:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ffd1ef26-8f74-4f89-b66f-3f33e35d31c1 req-d28f40f4-8fda-4349-815a-2a3151686283 service nova] Releasing lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG nova.compute.manager [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] No waiting events found dispatching network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:39:37 user nova-compute[72894]: WARNING nova.compute.manager [req-c08d3a7e-29db-48fa-9f7a-b21ce614cc9f req-63957173-c853-4e1b-a322-f18ea2090fe4 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received unexpected event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 for instance with vm_state building and task_state spawning.
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218379.348704, 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] VM Resumed (Lifecycle Event)
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Instance spawned successfully.
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218379.3500724, 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] VM Started (Lifecycle Event)
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:39:39 user nova-compute[72894]: INFO nova.compute.manager [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Took 5.93 seconds to build instance.
Aug 16 20:39:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4f80a02e-97e6-42ba-9b1c-16e385844bb2 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.025s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:39:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] No waiting events found dispatching network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:39:39 user nova-compute[72894]: WARNING nova.compute.manager [req-8b50756d-c819-43a4-93a5-7080dc8b0501 req-58eb2c88-1dd3-4ef5-b8d4-b417758530b9 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received unexpected event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 for instance with vm_state active and task_state None.
Aug 16 20:39:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:39:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:39:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:39:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:39:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:03 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:40:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:40:14 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:40:14 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=24.173843383789062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:40:14 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [{"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-91679ff4-3b94-4cdc-b320-cf4df9daf00d" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:40:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:40:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:40:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:13 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:14 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:41:14 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=24.173160552978516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:41:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:16 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:41:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:41:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-changed-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG nova.compute.manager [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Refreshing instance network info cache due to event network-changed-b6d5961d-fcf2-4c10-af96-a27929a9c730. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] Acquiring lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] Acquired lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG nova.network.neutron [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Refreshing network info cache for port b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:41:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:25 user nova-compute[72894]: DEBUG nova.network.neutron [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updated VIF entry in instance network info cache for port b6d5961d-fcf2-4c10-af96-a27929a9c730. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:41:25 user nova-compute[72894]: DEBUG nova.network.neutron [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:41:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-9591ab18-8af3-4cdb-89f2-835e29b8cd0b req-df441f49-534c-4c3f-930e-90b423422e97 service nova] Releasing lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:41:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:28 user nova-compute[72894]: INFO nova.compute.manager [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Attaching volume cf1de71b-1eca-4b0d-9147-fbb2fec785a6 to /dev/vdb
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.utils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2cecf5-5065-4468-b629-ebd53f74c012]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8235c68a-4080-41f6-af52-68389d1026d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3c879-0813-44b8-9a44-345c8ac1f7cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcf170-a33b-4019-8461-ced5fa3dbabb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:41:28 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:41:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe775ae-d569-4c5d-88ac-67bb9cb66552]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG os_brick.utils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:41:28 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating existing volume attachment record: 4d2dfb5e-aaf0-4a4b-b0e1-1418f90f524f {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:41:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:38 user nova-compute[72894]: INFO nova.compute.manager [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Terminating instance
Aug 16 20:41:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-unplugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] No waiting events found dispatching network-vif-unplugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG nova.compute.manager [req-3338dc03-e1ea-4a18-ae7c-fe59f8879d5e req-8f44d28b-2fc6-41a0-87ba-9c4882c44bc9 service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-unplugged-cc51564e-97bb-454c-bfe0-e89333e37910 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XItaAgUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:41:38 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:41:38 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:41:38 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b65728-7052-457a-a4d4-1125d1a06858]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:41:38 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0273c4-1808-4c48-83cd-718b49f337ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6] added
Aug 16 20:41:38 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f02bd-864e-450a-bba4-c262784a31d8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88e3967-62a4-4340-8aa9-9b64ea9cb7af]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XItaAgUJ {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XItaAgUJ" returned: 0 in 0.035s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[350da884-01a9-458f-9198-9fc51e525737]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XItaAgUJ'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Instance destroyed successfully.
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.objects.instance [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lazy-loading 'resources' on Instance uuid 91679ff4-3b94-4cdc-b320-cf4df9daf00d {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-949961094',display_name='tempest-ServersNegativeTestJSON-server-949961094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-949961094',id=45,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d91b2ae7a9674dfbab608bfe4a5472d8',ramdisk_id='',reservation_id='r-hev03mhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1085938696',owner_user_name='tempest-ServersNegativeTestJSON-1085938696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:32:51Z,user_data=None,user_id='b38af20e569843e59b979146b428d0c8',uuid=91679ff4-3b94-4cdc-b320-cf4df9daf00d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converting VIF {"id": "cc51564e-97bb-454c-bfe0-e89333e37910", "address": "fa:16:3e:cd:88:db", "network": {"id": "c5dc9c18-65ad-4bf4-9b12-37b5b8147612", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1230034562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d91b2ae7a9674dfbab608bfe4a5472d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc51564e-97", "ovs_interfaceid": "cc51564e-97bb-454c-bfe0-e89333e37910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_vif [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea7ee2-f1a8-4dbc-873a-dad74e000c2f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc51564e-97, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:39 user nova-compute[72894]: INFO os_vif [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:88:db,bridge_name='br-int',has_traffic_filtering=True,id=cc51564e-97bb-454c-bfe0-e89333e37910,network=Network(c5dc9c18-65ad-4bf4-9b12-37b5b8147612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc51564e-97')
Aug 16 20:41:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Deleting instance files /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d_del
Aug 16 20:41:39 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Deletion of /opt/stack/data/nova/instances/91679ff4-3b94-4cdc-b320-cf4df9daf00d_del complete
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b3cb9a-1b57-41b5-9d5e-d5763a2bc3b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:41:39 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:41:39 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:41:39 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:41:39 user nova-compute[72894]: 
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c0839-255c-4b3c-b4fd-4a4046d52a95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260]
Aug 16 20:41:39 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260] successful.
Aug 16 20:41:39 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: INFO nova.compute.manager [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a19a8e-d343-469b-86a7-6a4255cb805c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e399c9b6-28d3-4b1f-ae89-109f05f72ddc]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)
Aug 16 20:41:39 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)
Aug 16 20:41:39 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f97d85-7a60-40c6-9801-2524aa5f41ed]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XItaAgUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:41:39 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Took 0.61 seconds to deallocate network for instance.
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.compute.manager [req-0857d9ec-1d6d-43a8-8504-a7736aa924df req-8b224330-e082-4f38-8cea-d19e17ac46dd service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-deleted-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:41:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:40 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Deleted allocations for instance 91679ff4-3b94-4cdc-b320-cf4df9daf00d
Aug 16 20:41:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-109f888e-5819-47a2-9e3d-0deb13433ac8 tempest-ServersNegativeTestJSON-1085938696 tempest-ServersNegativeTestJSON-1085938696-project-member] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23933636461663763', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933636461663763', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.objects.instance [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:41:40 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:41:40 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:41:40 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:41:40 user nova-compute[72894]:   <serial>cf1de71b-1eca-4b0d-9147-fbb2fec785a6</serial>
Aug 16 20:41:40 user nova-compute[72894]: </disk>
Aug 16 20:41:40 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:07:8b:0c, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-62a51bff-ece9-4926-9329-0aaca13b8e79 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.202s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] Acquiring lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] Lock "91679ff4-3b94-4cdc-b320-cf4df9daf00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] No waiting events found dispatching network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:41:40 user nova-compute[72894]: WARNING nova.compute.manager [req-b6cddc7e-7e47-4cb2-9e0a-92e166f6589c req-02cc419c-e30e-42f8-8543-67187c03e23b service nova] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Received unexpected event network-vif-plugged-cc51564e-97bb-454c-bfe0-e89333e37910 for instance with vm_state deleted and task_state None.
Aug 16 20:41:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:41:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:41:41 user nova-compute[72894]: INFO nova.compute.manager [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Detaching volume cf1de71b-1eca-4b0d-9147-fbb2fec785a6
Aug 16 20:41:42 user nova-compute[72894]: INFO nova.virt.block_device [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Attempting to driver detach volume cf1de71b-1eca-4b0d-9147-fbb2fec785a6 from mountpoint /dev/vdb
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Attempting to detach device vdb from instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:41:42 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:41:42 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:41:42 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:41:42 user nova-compute[72894]:   <serial>cf1de71b-1eca-4b0d-9147-fbb2fec785a6</serial>
Aug 16 20:41:42 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:41:42 user nova-compute[72894]: </disk>
Aug 16 20:41:42 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:41:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 from the persistent domain config.
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:41:42 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:41:42 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:41:42 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:41:42 user nova-compute[72894]:   <serial>cf1de71b-1eca-4b0d-9147-fbb2fec785a6</serial>
Aug 16 20:41:42 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:41:42 user nova-compute[72894]: </disk>
Aug 16 20:41:42 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692218502.482743, 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:41:42 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 from the live domain config.
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XItaAgUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:41:42 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b9626-3ee1-4521-8695-f8753280b63b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b82db5-3ffb-4b8d-b82d-c67bf5075df9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)
Aug 16 20:41:42 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 (non-flash)
Aug 16 20:41:42 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c696710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca8b3cc-febe-4643-94b4-f446caf253f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[35948f0e-e765-447d-b246-1637e8a3f1ae]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c2f5d-230f-4f0f-acbc-79b11b43df65]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057ec11-6362-4291-93cd-691298805a15]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f4dce-f94b-4396-96a3-5d0b9757b050]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a46eec8-9669-4170-b445-5629be510d15]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260]
Aug 16 20:41:42 user nova-compute[72894]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6, portal: 172.16.0.220,3260] successful.
Aug 16 20:41:42 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1de71b-1eca-4b0d-9147-fbb2fec785a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ba3fe-12b6-43d9-ac11-43b6f6ea3f18]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== disconnect_volume: return (308ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:41:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:41:43 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:41:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c82226a9-11bc-40be-bcb5-ffadbab8adc0 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:41:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218499.0463445, 91679ff4-3b94-4cdc-b320-cf4df9daf00d => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:41:54 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] VM Stopped (Lifecycle Event)
Aug 16 20:41:54 user nova-compute[72894]: DEBUG nova.compute.manager [None req-206764c6-43f6-46d0-b4b1-cc9fd18e5ed7 None None] [instance: 91679ff4-3b94-4cdc-b320-cf4df9daf00d] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:41:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:41:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:41:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:04 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:42:14 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [{"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:42:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:42:16 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:42:16 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=24.199630737304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:42:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:42:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:42:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:42:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:32 user nova-compute[72894]: INFO nova.compute.manager [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Terminating instance
Aug 16 20:42:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-unplugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] No waiting events found dispatching network-vif-unplugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:42:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-bcc85a1f-9842-4c67-b550-5fa51bccb471 req-bb797b27-e0ee-4daa-b831-8af6cb9dd57a service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-unplugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:42:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Instance destroyed successfully.
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'resources' on Instance uuid 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:39:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-28217786',display_name='tempest-AttachVolumeNegativeTest-server-28217786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-28217786',id=49,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEfi3UPkOYMK73p4rngpePVYU8kfrLOOk547QNWmpnGEAUQarCLOjKwGQL81flqpWshVL8Bm5aARnYtJWcFTprSX7PutbwqoX8kR2t35PrjYXVbLUNzjLyPzcklqqquZQ==',key_name='tempest-keypair-1480727313',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:39:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-td03bg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=4ff5cfb8-c49d-40c9-832c-0d08d4ba8097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "address": "fa:16:3e:07:8b:0c", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d5961d-fc", "ovs_interfaceid": "b6d5961d-fcf2-4c10-af96-a27929a9c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG os_vif [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6d5961d-fc, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:42:33 user nova-compute[72894]: INFO os_vif [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:8b:0c,bridge_name='br-int',has_traffic_filtering=True,id=b6d5961d-fcf2-4c10-af96-a27929a9c730,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d5961d-fc')
Aug 16 20:42:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Deleting instance files /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097_del
Aug 16 20:42:33 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Deletion of /opt/stack/data/nova/instances/4ff5cfb8-c49d-40c9-832c-0d08d4ba8097_del complete
Aug 16 20:42:33 user nova-compute[72894]: INFO nova.compute.manager [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 20:42:33 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:42:33 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:42:34 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Took 0.93 seconds to deallocate network for instance.
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:34 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Deleted allocations for instance 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] Acquiring lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] No waiting events found dispatching network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:42:34 user nova-compute[72894]: WARNING nova.compute.manager [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received unexpected event network-vif-plugged-b6d5961d-fcf2-4c10-af96-a27929a9c730 for instance with vm_state deleted and task_state None.
Aug 16 20:42:34 user nova-compute[72894]: DEBUG nova.compute.manager [req-fdb583fb-99d3-41f0-853f-b044e075a8e9 req-f2e0c141-338c-470a-a8fc-0dcae56a4882 service nova] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Received event network-vif-deleted-b6d5961d-fcf2-4c10-af96-a27929a9c730 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:42:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-71067b3d-9585-4bae-9d00-e3f6aefbb0bc tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "4ff5cfb8-c49d-40c9-832c-0d08d4ba8097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:42:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:48 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218553.192436, 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:42:48 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] VM Stopped (Lifecycle Event)
Aug 16 20:42:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-0f2454a2-82a3-4474-8ee3-b3ab26b4c48b None None] [instance: 4ff5cfb8-c49d-40c9-832c-0d08d4ba8097] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:42:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:42:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:42:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:07 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:14 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:43:16 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:43:16 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=24.225753784179688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:43:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:43:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:43:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:43:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:43:23 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:43:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:43:27 user nova-compute[72894]: INFO nova.compute.claims [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Claim successful on node user
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:43:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.policy [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47688eefc16243728ca8f89e4d7dc8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06017cd5904bd7b841d9626a0d10ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:43:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Creating image(s)
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "/opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "/opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.197s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk 1073741824" returned: 0 in 0.055s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Successfully created port: bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Cannot resize image /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'migration_context' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Ensure instance console log exists: /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Successfully updated port: bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-changed-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Refreshing instance network info cache due to event network-changed-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:43:28 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Instance network_info: |[{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Refreshing network info cache for port bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Start _get_guest_xml network_info=[{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:43:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:43:29 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1827822023',display_name='tempest-AttachVolumeNegativeTest-server-1827822023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1827822023',id=50,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDiwNgQeZZmDSpMjojvye5e6oh6KeC9uh78TB5GpGrg8RbJKCtnSQeg30bMWaOdh9tNW6inSZtbtg6xgu4dhRNgo02yml8lc4sDtoolpx91vDXq2WSV+5wUDuoLU2R8+g==',key_name='tempest-keypair-668785648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-uevngkbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=87094eb6-3d18-4f8a-8b93-9c4260fc1f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'pci_devices' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:43:29 user nova-compute[72894]:   <uuid>87094eb6-3d18-4f8a-8b93-9c4260fc1f90</uuid>
Aug 16 20:43:29 user nova-compute[72894]:   <name>instance-00000032</name>
Aug 16 20:43:29 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:43:29 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:43:29 user nova-compute[72894]:   <metadata>
Aug 16 20:43:29 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:43:29 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1827822023</nova:name>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:43:29</nova:creationTime>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:43:29 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:43:29 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:owner>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:user uuid="47688eefc16243728ca8f89e4d7dc8e3">tempest-AttachVolumeNegativeTest-1791980769-project-member</nova:user>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:project uuid="1c06017cd5904bd7b841d9626a0d10ae">tempest-AttachVolumeNegativeTest-1791980769</nova:project>
Aug 16 20:43:29 user nova-compute[72894]:       </nova:owner>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:43:29 user nova-compute[72894]:       <nova:ports>
Aug 16 20:43:29 user nova-compute[72894]:         <nova:port uuid="bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c">
Aug 16 20:43:29 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 20:43:29 user nova-compute[72894]:         </nova:port>
Aug 16 20:43:29 user nova-compute[72894]:       </nova:ports>
Aug 16 20:43:29 user nova-compute[72894]:     </nova:instance>
Aug 16 20:43:29 user nova-compute[72894]:   </metadata>
Aug 16 20:43:29 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:43:29 user nova-compute[72894]:     <system>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="serial">87094eb6-3d18-4f8a-8b93-9c4260fc1f90</entry>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="uuid">87094eb6-3d18-4f8a-8b93-9c4260fc1f90</entry>
Aug 16 20:43:29 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:43:29 user nova-compute[72894]:     </system>
Aug 16 20:43:29 user nova-compute[72894]:   </sysinfo>
Aug 16 20:43:29 user nova-compute[72894]:   <os>
Aug 16 20:43:29 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:43:29 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:43:29 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:43:29 user nova-compute[72894]:   </os>
Aug 16 20:43:29 user nova-compute[72894]:   <features>
Aug 16 20:43:29 user nova-compute[72894]:     <acpi/>
Aug 16 20:43:29 user nova-compute[72894]:     <apic/>
Aug 16 20:43:29 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:43:29 user nova-compute[72894]:   </features>
Aug 16 20:43:29 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:43:29 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:43:29 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:43:29 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:43:29 user nova-compute[72894]:   </clock>
Aug 16 20:43:29 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:43:29 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:43:29 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:43:29 user nova-compute[72894]:   </cpu>
Aug 16 20:43:29 user nova-compute[72894]:   <devices>
Aug 16 20:43:29 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:43:29 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:43:29 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk"/>
Aug 16 20:43:29 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:43:29 user nova-compute[72894]:     </disk>
Aug 16 20:43:29 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:43:29 user nova-compute[72894]:       <mac address="fa:16:3e:ee:5f:90"/>
Aug 16 20:43:29 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:43:29 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:43:29 user nova-compute[72894]:       <target dev="tapbf71fb7e-bd"/>
Aug 16 20:43:29 user nova-compute[72894]:     </interface>
Aug 16 20:43:29 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:43:29 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/console.log" append="off"/>
Aug 16 20:43:29 user nova-compute[72894]:     </serial>
Aug 16 20:43:29 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:43:29 user nova-compute[72894]:     <video>
Aug 16 20:43:29 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:43:29 user nova-compute[72894]:     </video>
Aug 16 20:43:29 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:43:29 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:43:29 user nova-compute[72894]:     </rng>
Aug 16 20:43:29 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:43:29 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:43:29 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:43:29 user nova-compute[72894]:     </memballoon>
Aug 16 20:43:29 user nova-compute[72894]:   </devices>
Aug 16 20:43:29 user nova-compute[72894]: </domain>
Aug 16 20:43:29 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1827822023',display_name='tempest-AttachVolumeNegativeTest-server-1827822023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1827822023',id=50,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDiwNgQeZZmDSpMjojvye5e6oh6KeC9uh78TB5GpGrg8RbJKCtnSQeg30bMWaOdh9tNW6inSZtbtg6xgu4dhRNgo02yml8lc4sDtoolpx91vDXq2WSV+5wUDuoLU2R8+g==',key_name='tempest-keypair-668785648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-uevngkbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=87094eb6-3d18-4f8a-8b93-9c4260fc1f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG os_vif [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf71fb7e-bd, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf71fb7e-bd, col_values=(('external_ids', {'iface-id': 'bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:5f:90', 'vm-uuid': '87094eb6-3d18-4f8a-8b93-9c4260fc1f90'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:29 user nova-compute[72894]: INFO os_vif [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd')
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:ee:5f:90, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updated VIF entry in instance network info cache for port bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG nova.network.neutron [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:43:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f6c0c113-ea70-48f1-9751-45eb6bb013ae req-3bf80416-dcf1-45ef-90f3-08186b4e6c39 service nova] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:30 user nova-compute[72894]: DEBUG nova.compute.manager [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] No waiting events found dispatching network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:43:30 user nova-compute[72894]: WARNING nova.compute.manager [req-310af81b-1611-42d9-add9-fc6dea1653d9 req-a3883d18-4e64-4533-b8e9-8c6c4d625d0d service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received unexpected event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c for instance with vm_state building and task_state spawning.
Aug 16 20:43:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218612.71831, 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] VM Resumed (Lifecycle Event)
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Instance spawned successfully.
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218612.7223897, 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] VM Started (Lifecycle Event)
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:43:32 user nova-compute[72894]: INFO nova.compute.manager [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Took 5.84 seconds to build instance.
Aug 16 20:43:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bf5373f2-07fd-415b-89be-9a2748139868 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.977s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:43:32 user nova-compute[72894]: DEBUG nova.compute.manager [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] No waiting events found dispatching network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:43:32 user nova-compute[72894]: WARNING nova.compute.manager [req-65199354-ec4a-4a24-ad39-0e9fccd741ea req-0160a2f0-9d89-427f-b23e-dbb9379fab57 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received unexpected event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c for instance with vm_state active and task_state None.
Aug 16 20:43:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:43:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:06 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:44:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:44:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:44:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=24.19567108154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:44:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:44:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:44:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:44:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:44:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:44:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:44:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:44:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:44:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:44:56 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:44:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:44:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:45:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:08 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:45:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=24.19512939453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-changed-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Refreshing instance network info cache due to event network-changed-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Refreshing network info cache for port bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updated VIF entry in instance network info cache for port bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG nova.network.neutron [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:45:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa153a0d-8dad-4f4a-b618-2508592d0957 req-5d05edff-c66c-4b7e-8eb5-aa72a303160e service nova] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:45:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:45:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:45:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:45:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:21 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:45:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:22 user nova-compute[72894]: INFO nova.compute.manager [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Attaching volume 9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad to /dev/vdb
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.utils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[85969a98-4a1c-43a2-afd6-30a389616ad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb97ba3-92b6-448f-9a06-e7bf2c239739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f475c28c-dc5b-417e-913b-4b97f0229016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad364df1-b3ee-4519-8ec8-46b48abd430f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:45:22 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:45:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[41354476-80fb-4ea8-91ef-3070360738a5]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG os_brick.utils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:45:22 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating existing volume attachment record: e1fe7bc7-01b1-4211-abad-039e41295537 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:45:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:45:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:45:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzpsjYmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:45:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:45:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:45:32 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[369b6632-79ff-4e11-9364-d6dd969b25ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:45:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeef8e34-ba2d-4fdc-b3af-c293046c5e67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad] added
Aug 16 20:45:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18a856-a3d7-4f44-8c2d-b2716551218e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e0c061-289b-41ec-a46a-df1315c0b5b1]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tzpsjYmK {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tzpsjYmK" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb23579f-4350-4d45-ae61-3422f5076d9d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tzpsjYmK'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b89b1-3c1f-446a-a5d7-f762374574fd]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78395be9-855d-422c-89be-4ba6603f759f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:45:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:45:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:45:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:45:32 user nova-compute[72894]: 
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7724081-c673-4aad-a3d9-5e8a4e5dac56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260]
Aug 16 20:45:32 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260] successful.
Aug 16 20:45:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff787c-abd7-4baa-8bf6-334ff01399f6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8468f15-bacf-4b43-bbdf-6cf9a3425ec9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)
Aug 16 20:45:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)
Aug 16 20:45:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90877c1-ccd7-40ca-884b-e98b0fdaa873]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzpsjYmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26335663638336662', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335663638336662', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:45:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:45:33 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:45:33 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:45:33 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:45:33 user nova-compute[72894]:   <serial>9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad</serial>
Aug 16 20:45:33 user nova-compute[72894]: </disk>
Aug 16 20:45:33 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] No VIF found with MAC fa:16:3e:ee:5f:90, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-d60790aa-2f22-4311-a596-2fe4a3e043a7 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.008s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:45:35 user nova-compute[72894]: INFO nova.compute.manager [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Detaching volume 9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad
Aug 16 20:45:35 user nova-compute[72894]: INFO nova.virt.block_device [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Attempting to driver detach volume 9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad from mountpoint /dev/vdb
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Attempting to detach device vdb from instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:45:35 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:45:35 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:45:35 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:45:35 user nova-compute[72894]:   <serial>9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad</serial>
Aug 16 20:45:35 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:45:35 user nova-compute[72894]: </disk>
Aug 16 20:45:35 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:45:35 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 from the persistent domain config.
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:45:35 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:45:35 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:45:35 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:45:35 user nova-compute[72894]:   <serial>9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad</serial>
Aug 16 20:45:35 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:45:35 user nova-compute[72894]: </disk>
Aug 16 20:45:35 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692218735.972598, 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:45:35 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully detached device vdb from instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 from the live domain config.
Aug 16 20:45:35 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tzpsjYmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:45:35 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:45:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:45:35 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6885404-4552-49ed-b92b-80fb82f4bd58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f160a38-4e99-4282-9002-2ed03b87c24f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)
Aug 16 20:45:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad (non-flash)
Aug 16 20:45:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c3609d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ec49e-b1f9-4866-96f4-878f1e68c4b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad02253-ac78-4ea8-8116-d6f9799904f2]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba38586b-f6cf-418b-81b0-4a35d21a8b54]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee01279b-bd8c-4e5c-b583-4daafc0ded29]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c535dc3-bd89-4b7d-b55c-8afe546acc26]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2f1ba-ef9b-4aa5-bf44-df1d1344680c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260]
Aug 16 20:45:36 user nova-compute[72894]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad, portal: 172.16.0.220,3260] successful.
Aug 16 20:45:36 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb33f-cf0e-469c-b96c-9cfd7bb016ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c1b66-ac29-4bb1-93dd-9c6220d4c348]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] <== disconnect_volume: return (259ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:45:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:45:37 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'flavor' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:45:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0c52672c-5827-4980-812f-62720ae2f938 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.645s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:45:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:45:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:46:16 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:46:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:46:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.194091796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:46:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [{"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-87094eb6-3d18-4f8a-8b93-9c4260fc1f90" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:46:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:46:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:25 user nova-compute[72894]: INFO nova.compute.manager [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Terminating instance
Aug 16 20:46:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-unplugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] No waiting events found dispatching network-vif-unplugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:46:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-95d4f99b-4a91-4403-a5e6-3f33159c020d req-721c1c0d-fd81-4eb9-9c8c-77671b65b4ef service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-unplugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Instance destroyed successfully.
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lazy-loading 'resources' on Instance uuid 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1827822023',display_name='tempest-AttachVolumeNegativeTest-server-1827822023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1827822023',id=50,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDiwNgQeZZmDSpMjojvye5e6oh6KeC9uh78TB5GpGrg8RbJKCtnSQeg30bMWaOdh9tNW6inSZtbtg6xgu4dhRNgo02yml8lc4sDtoolpx91vDXq2WSV+5wUDuoLU2R8+g==',key_name='tempest-keypair-668785648',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c06017cd5904bd7b841d9626a0d10ae',ramdisk_id='',reservation_id='r-uevngkbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1791980769',owner_user_name='tempest-AttachVolumeNegativeTest-1791980769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:43:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47688eefc16243728ca8f89e4d7dc8e3',uuid=87094eb6-3d18-4f8a-8b93-9c4260fc1f90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converting VIF {"id": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "address": "fa:16:3e:ee:5f:90", "network": {"id": "a73fa2e6-b5b2-4a6c-ad91-19106dad5e31", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-499654857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c06017cd5904bd7b841d9626a0d10ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf71fb7e-bd", "ovs_interfaceid": "bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG os_vif [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf71fb7e-bd, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:26 user nova-compute[72894]: INFO os_vif [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c,network=Network(a73fa2e6-b5b2-4a6c-ad91-19106dad5e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf71fb7e-bd')
Aug 16 20:46:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Deleting instance files /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90_del
Aug 16 20:46:26 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Deletion of /opt/stack/data/nova/instances/87094eb6-3d18-4f8a-8b93-9c4260fc1f90_del complete
Aug 16 20:46:26 user nova-compute[72894]: INFO nova.compute.manager [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 20:46:26 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:46:26 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:46:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:46:27 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Took 1.35 seconds to deallocate network for instance.
Aug 16 20:46:27 user nova-compute[72894]: DEBUG nova.compute.manager [req-77ffe2e6-4b33-4da6-bf05-2b9a770ecbdd req-e03365e6-ee09-46d3-8a83-45b154a62ac6 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-deleted-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:46:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] Acquiring lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] No waiting events found dispatching network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:46:28 user nova-compute[72894]: WARNING nova.compute.manager [req-aba7f4d0-cd21-4021-8597-cf281aac692e req-94b0654a-3a0c-420c-8484-ce3e247e08a8 service nova] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Received unexpected event network-vif-plugged-bf71fb7e-bd58-4ac6-b76d-2daf30c0d83c for instance with vm_state deleted and task_state None.
Aug 16 20:46:28 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:28 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Deleted allocations for instance 87094eb6-3d18-4f8a-8b93-9c4260fc1f90
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-e715ba56-21c4-4c07-98a4-111e6cf2a380 tempest-AttachVolumeNegativeTest-1791980769 tempest-AttachVolumeNegativeTest-1791980769-project-member] Lock "87094eb6-3d18-4f8a-8b93-9c4260fc1f90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.501s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:46:28 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:46:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:41 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692218786.4679217, 87094eb6-3d18-4f8a-8b93-9c4260fc1f90 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:46:41 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] VM Stopped (Lifecycle Event)
Aug 16 20:46:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ae210108-ea2f-4065-a494-46dbd152ffce None None] [instance: 87094eb6-3d18-4f8a-8b93-9c4260fc1f90] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:46:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:46:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:47:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:47:17 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=24.21337890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:47:17 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:47:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:47:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:47:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:47:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:47:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:47:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:47:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:47:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:47:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:48:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:06 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:11 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:48:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:16 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:48:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:48:18 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.21108627319336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:48:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:20 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:21 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:48:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:48:24 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:48:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:48:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:48:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:48:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:36 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:48:41 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:46 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:51 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:56 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:48:56 user nova-compute[72894]: INFO nova.compute.claims [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Claim successful on node user
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:48:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.policy [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '770735fb923c40e7a744b5b0936f8c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e93dc49af24c47904574eac115f720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:48:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Creating image(s)
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "/opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "/opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "/opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.194s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk 1073741824" returned: 0 in 0.046s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:48:57 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Successfully created port: 1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.180s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Cannot resize image /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'migration_context' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Ensure instance console log exists: /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Successfully updated port: 1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:48:58 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-changed-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.compute.manager [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Refreshing instance network info cache due to event network-changed-1c835700-7a28-402d-baf8-227e372125e3. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.neutron [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Instance network_info: |[{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Refreshing network info cache for port 1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Start _get_guest_xml network_info=[{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:48:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:48:59 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9624839',id=51,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG2lbO7p67FpQ66aOKDQ86H2Df8FqPnqL81iWrS5Ks9qvZkPxOHnkmv7cI3cPdcr/+CT5zhk/VOc2isq3a4eA/aeXL8M/I/TW8glzu/M+twu7eSgyEbAx65JjRf4QzsjQ==',key_name='tempest-keypair-1507793564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e93dc49af24c47904574eac115f720',ramdisk_id='',reservation_id='r-64sks0ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='770735fb923c40e7a744b5b0936f8c8c',uuid=a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converting VIF {"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'pci_devices' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:48:59 user nova-compute[72894]:   <uuid>a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64</uuid>
Aug 16 20:48:59 user nova-compute[72894]:   <name>instance-00000033</name>
Aug 16 20:48:59 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:48:59 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:48:59 user nova-compute[72894]:   <metadata>
Aug 16 20:48:59 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:48:59 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927</nova:name>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:48:59</nova:creationTime>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:48:59 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:48:59 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:owner>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:user uuid="770735fb923c40e7a744b5b0936f8c8c">tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member</nova:user>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:project uuid="66e93dc49af24c47904574eac115f720">tempest-TestServerVolumeAttachScenarioOldVersion-554105230</nova:project>
Aug 16 20:48:59 user nova-compute[72894]:       </nova:owner>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:48:59 user nova-compute[72894]:       <nova:ports>
Aug 16 20:48:59 user nova-compute[72894]:         <nova:port uuid="1c835700-7a28-402d-baf8-227e372125e3">
Aug 16 20:48:59 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 20:48:59 user nova-compute[72894]:         </nova:port>
Aug 16 20:48:59 user nova-compute[72894]:       </nova:ports>
Aug 16 20:48:59 user nova-compute[72894]:     </nova:instance>
Aug 16 20:48:59 user nova-compute[72894]:   </metadata>
Aug 16 20:48:59 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:48:59 user nova-compute[72894]:     <system>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="serial">a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64</entry>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="uuid">a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64</entry>
Aug 16 20:48:59 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:48:59 user nova-compute[72894]:     </system>
Aug 16 20:48:59 user nova-compute[72894]:   </sysinfo>
Aug 16 20:48:59 user nova-compute[72894]:   <os>
Aug 16 20:48:59 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:48:59 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:48:59 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:48:59 user nova-compute[72894]:   </os>
Aug 16 20:48:59 user nova-compute[72894]:   <features>
Aug 16 20:48:59 user nova-compute[72894]:     <acpi/>
Aug 16 20:48:59 user nova-compute[72894]:     <apic/>
Aug 16 20:48:59 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:48:59 user nova-compute[72894]:   </features>
Aug 16 20:48:59 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:48:59 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:48:59 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:48:59 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:48:59 user nova-compute[72894]:   </clock>
Aug 16 20:48:59 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:48:59 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:48:59 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:48:59 user nova-compute[72894]:   </cpu>
Aug 16 20:48:59 user nova-compute[72894]:   <devices>
Aug 16 20:48:59 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:48:59 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:48:59 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk"/>
Aug 16 20:48:59 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:48:59 user nova-compute[72894]:     </disk>
Aug 16 20:48:59 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:48:59 user nova-compute[72894]:       <mac address="fa:16:3e:de:d1:77"/>
Aug 16 20:48:59 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:48:59 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:48:59 user nova-compute[72894]:       <target dev="tap1c835700-7a"/>
Aug 16 20:48:59 user nova-compute[72894]:     </interface>
Aug 16 20:48:59 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:48:59 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/console.log" append="off"/>
Aug 16 20:48:59 user nova-compute[72894]:     </serial>
Aug 16 20:48:59 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:48:59 user nova-compute[72894]:     <video>
Aug 16 20:48:59 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:48:59 user nova-compute[72894]:     </video>
Aug 16 20:48:59 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:48:59 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:48:59 user nova-compute[72894]:     </rng>
Aug 16 20:48:59 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:48:59 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:48:59 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:48:59 user nova-compute[72894]:     </memballoon>
Aug 16 20:48:59 user nova-compute[72894]:   </devices>
Aug 16 20:48:59 user nova-compute[72894]: </domain>
Aug 16 20:48:59 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9624839',id=51,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG2lbO7p67FpQ66aOKDQ86H2Df8FqPnqL81iWrS5Ks9qvZkPxOHnkmv7cI3cPdcr/+CT5zhk/VOc2isq3a4eA/aeXL8M/I/TW8glzu/M+twu7eSgyEbAx65JjRf4QzsjQ==',key_name='tempest-keypair-1507793564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e93dc49af24c47904574eac115f720',ramdisk_id='',reservation_id='r-64sks0ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='770735fb923c40e7a744b5b0936f8c8c',uuid=a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converting VIF {"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG os_vif [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c835700-7a, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c835700-7a, col_values=(('external_ids', {'iface-id': '1c835700-7a28-402d-baf8-227e372125e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d1:77', 'vm-uuid': 'a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:48:59 user nova-compute[72894]: INFO os_vif [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a')
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] No VIF found with MAC fa:16:3e:de:d1:77, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updated VIF entry in instance network info cache for port 1c835700-7a28-402d-baf8-227e372125e3. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG nova.network.neutron [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-7e1c91fe-8703-43e5-807a-3309ad59c9bc req-e659837a-a51a-4077-906d-7e23fc8fad90 service nova] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:48:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG nova.compute.manager [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] No waiting events found dispatching network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:49:01 user nova-compute[72894]: WARNING nova.compute.manager [req-e0a89ab7-4fe0-49e2-a594-1dac167e8a97 req-d6d3dd27-3c7a-4ce5-9b49-4188c0bfe095 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received unexpected event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 for instance with vm_state building and task_state spawning.
Aug 16 20:49:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] No waiting events found dispatching network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:49:03 user nova-compute[72894]: WARNING nova.compute.manager [req-711bb1be-f4a9-40d5-97f5-2f38546928d4 req-11c9c8d1-726c-4e87-a4d2-dbad624dba13 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received unexpected event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 for instance with vm_state building and task_state spawning.
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218943.128464, a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] VM Resumed (Lifecycle Event)
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Instance spawned successfully.
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692218943.1302648, a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] VM Started (Lifecycle Event)
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 16 20:49:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:49:03 user nova-compute[72894]: INFO nova.compute.manager [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Took 6.39 seconds to build instance.
Aug 16 20:49:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-9cd22e39-84b2-435f-b636-c94fcbb2d6af tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.486s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:49:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:10 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:11 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:49:18 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:49:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:49:19 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=24.1820068359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:49:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:49:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:49:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:49:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:00 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:00 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:50:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:50:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:19 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:50:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:50:20 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=24.179737091064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:50:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:50:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:50:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:50:26 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:50:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:50:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:50:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:50:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:50:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:50:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-changed-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:50:48 user nova-compute[72894]: DEBUG nova.compute.manager [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Refreshing instance network info cache due to event network-changed-1c835700-7a28-402d-baf8-227e372125e3. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:50:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:50:48 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:50:48 user nova-compute[72894]: DEBUG nova.network.neutron [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Refreshing network info cache for port 1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:50:49 user nova-compute[72894]: DEBUG nova.network.neutron [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updated VIF entry in instance network info cache for port 1c835700-7a28-402d-baf8-227e372125e3. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:50:49 user nova-compute[72894]: DEBUG nova.network.neutron [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:50:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cbd0964b-c6d7-4f97-a1fc-b8257ef6caf8 req-448e8734-f7e3-47ff-abab-e74eda318a87 service nova] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:50:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'flavor' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:50:52 user nova-compute[72894]: INFO nova.compute.manager [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Attaching volume 9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e to /dev/vdb
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.utils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfba723c-4db1-4ceb-b19d-33c041ace715]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a68f9b-d666-4e23-8dbc-8586cebe0720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ec429-2bdb-40af-93d2-d29efe65066c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc19a53-a7cf-4f20-95df-fb146ff103d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:50:52 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:50:52 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7809fa-ee62-4f05-b445-8cbe63df2afc]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG os_brick.utils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:50:52 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating existing volume attachment record: fa46d1de-6d4e-41a6-a1ea-759c04817c87 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:50:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:50:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:51:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aRunIPjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:51:02 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:51:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:51:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:51:03 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c52fae-59b0-4ce8-ae72-6aac9004b3bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:51:03 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28e4b0f-cbc8-4450-a072-8c8735c52c87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e] added
Aug 16 20:51:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca55f32-76f3-4d7a-b597-4b5b3f63991c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e483859-f978-48a2-8839-98e2dc01b5c3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aRunIPjG {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aRunIPjG" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c9c81-7aad-4b38-aa7b-12e0647b86b3]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aRunIPjG'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e6fefb-415b-4bd9-995c-7dcacbaa57bc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[415a0f55-a1f2-4104-9e8e-822752ab63c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:51:03 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:51:03 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:51:03 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:51:03 user nova-compute[72894]: 
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[583fc592-3f5d-439d-8eae-6d381a523f9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260]
Aug 16 20:51:03 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260] successful.
Aug 16 20:51:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e1fe57-60ae-444d-ba70-d9ca2feef682]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[659ccd2f-327d-4831-8d54-fae5f4582bb1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)
Aug 16 20:51:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)
Aug 16 20:51:03 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f3943-07a2-435f-9a43-ebba10f15215]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:03 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aRunIPjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26433663039636238', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433663039636238', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'flavor' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:51:04 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:51:04 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:51:04 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:51:04 user nova-compute[72894]:   <serial>9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e</serial>
Aug 16 20:51:04 user nova-compute[72894]: </disk>
Aug 16 20:51:04 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] No VIF found with MAC fa:16:3e:de:d1:77, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-5c6a7309-cabf-4320-9265-ca285d571ece tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.098s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:51:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:51:06 user nova-compute[72894]: INFO nova.compute.manager [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Detaching volume 9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e
Aug 16 20:51:06 user nova-compute[72894]: INFO nova.virt.block_device [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Attempting to driver detach volume 9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e from mountpoint /dev/vdb
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Attempting to detach device vdb from instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:51:06 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:51:06 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:51:06 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:51:06 user nova-compute[72894]:   <serial>9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e</serial>
Aug 16 20:51:06 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:51:06 user nova-compute[72894]: </disk>
Aug 16 20:51:06 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:51:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Successfully detached device vdb from instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 from the persistent domain config.
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:51:06 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:51:06 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:51:06 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:51:06 user nova-compute[72894]:   <serial>9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e</serial>
Aug 16 20:51:06 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:51:06 user nova-compute[72894]: </disk>
Aug 16 20:51:06 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219066.851287, a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:51:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Successfully detached device vdb from instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 from the live domain config.
Aug 16 20:51:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aRunIPjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:51:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a988b92-7951-4b1c-bd27-04ed525ee62b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a91e7-4195-437e-bced-b81c01074b8a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)
Aug 16 20:51:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e (non-flash)
Aug 16 20:51:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990454040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de5e46-268e-48a0-bf0c-194fc6b53d14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[075cf806-595e-4fba-92b5-8aaba7a4b0b7]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f571e-7a23-4ac5-8dc6-486b8a9dfb32]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:51:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c74f7a-0dd4-43c5-a989-57bb4c95fdc3]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8bb7d9-6bef-4ee7-9c27-9b0f6d1e1a31]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5ef9c-81be-4822-a9ab-1d0fb534413e]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260]
Aug 16 20:51:07 user nova-compute[72894]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e, portal: 172.16.0.220,3260] successful.
Aug 16 20:51:07 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9354e62d-aca0-4cf5-96cd-e7b9b77a7f5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c9614-87b3-425c-aa5f-bd548d95c72a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] <== disconnect_volume: return (280ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'flavor' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:51:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-68542182-aada-417f-98a9-7b4ff3967c57 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:51:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:51:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:51:21 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:51:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:51:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=24.178512573242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:51:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:51:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [{"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:51:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:51:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:51:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:51:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:51:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:03 user nova-compute[72894]: INFO nova.compute.manager [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Terminating instance
Aug 16 20:52:03 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-unplugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] No waiting events found dispatching network-vif-unplugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:52:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-c24ce8c7-6089-4d3e-9ec0-ed3c4be07a1d req-19e80457-d846-432a-a128-ad3ec6f9ba80 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-unplugged-1c835700-7a28-402d-baf8-227e372125e3 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 20:52:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Instance destroyed successfully.
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lazy-loading 'resources' on Instance uuid a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-962483927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9624839',id=51,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG2lbO7p67FpQ66aOKDQ86H2Df8FqPnqL81iWrS5Ks9qvZkPxOHnkmv7cI3cPdcr/+CT5zhk/VOc2isq3a4eA/aeXL8M/I/TW8glzu/M+twu7eSgyEbAx65JjRf4QzsjQ==',key_name='tempest-keypair-1507793564',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:49:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66e93dc49af24c47904574eac115f720',ramdisk_id='',reservation_id='r-64sks0ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='770735fb923c40e7a744b5b0936f8c8c',uuid=a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converting VIF {"id": "1c835700-7a28-402d-baf8-227e372125e3", "address": "fa:16:3e:de:d1:77", "network": {"id": "f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2111032313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e93dc49af24c47904574eac115f720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c835700-7a", "ovs_interfaceid": "1c835700-7a28-402d-baf8-227e372125e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG os_vif [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c835700-7a, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:04 user nova-compute[72894]: INFO os_vif [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:77,bridge_name='br-int',has_traffic_filtering=True,id=1c835700-7a28-402d-baf8-227e372125e3,network=Network(f81d8fd8-1cf7-4311-b2d0-953d1bfee5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c835700-7a')
Aug 16 20:52:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Deleting instance files /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64_del
Aug 16 20:52:04 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Deletion of /opt/stack/data/nova/instances/a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64_del complete
Aug 16 20:52:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:04 user nova-compute[72894]: INFO nova.compute.manager [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 20:52:04 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 20:52:04 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:52:05 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Took 0.96 seconds to deallocate network for instance.
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-34ce6ea6-1441-44b5-b6cd-4737c306bd47 req-a2764ee7-c119-4490-ba91-2d6eee8819b9 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-deleted-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:05 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Deleted allocations for instance a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c6cd3ea6-f2ca-4cc4-8b04-4ea4bccc3972 tempest-TestServerVolumeAttachScenarioOldVersion-554105230 tempest-TestServerVolumeAttachScenarioOldVersion-554105230-project-member] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] Acquiring lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] Lock "a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] No waiting events found dispatching network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:52:05 user nova-compute[72894]: WARNING nova.compute.manager [req-f7ed718e-a129-49b8-a002-cd75dd764718 req-a41e7612-25fa-4d1a-b8af-8c191a4e6cd8 service nova] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Received unexpected event network-vif-plugged-1c835700-7a28-402d-baf8-227e372125e3 for instance with vm_state deleted and task_state None.
Aug 16 20:52:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:13 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:14 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:19 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692219124.080069, a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:52:19 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] VM Stopped (Lifecycle Event)
Aug 16 20:52:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-ea9e9610-f2b2-4c4c-ad12-4a80fe4c519d None None] [instance: a86e7dc7-9e11-40e9-a7ce-5d60dfe84a64] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:52:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:52:21 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=24.205657958984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:52:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:52:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:52:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:52:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 20:52:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:34 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:52:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:52:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:52:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:52:59 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:01 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:04 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:09 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:14 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:15 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 20:53:19 user nova-compute[72894]: INFO nova.compute.claims [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Claim successful on node user
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 20:53:19 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 20:53:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.policy [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c1b80e807664bbdbeeacb27dc5b131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca10efde105d4ac08f0de89763f45e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 20:53:20 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Creating image(s)
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "/opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "/opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "/opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.052s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.169s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk 1073741824" returned: 0 in 0.057s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.190s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Successfully created port: 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Cannot resize image /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 20:53:20 user nova-compute[72894]: DEBUG nova.objects.instance [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'migration_context' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Ensure instance console log exists: /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Successfully updated port: 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-changed-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.compute.manager [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Refreshing instance network info cache due to event network-changed-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:53:21 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.neutron [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Instance network_info: |[{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Refreshing network info cache for port 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Start _get_guest_xml network_info=[{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 20:53:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:53:22 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152954234',display_name='tempest-SnapshotDataIntegrityTests-server-152954234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152954234',id=52,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPb1iOXTifA9yfdzIVRifE4Wu5HpDwQ1ZX7JTg1YIo13v40ScVNEdtlycReQnpO1sO11yg1NRQQWib8f5wigMHhp9T18XvnC9db9R632+Bqv1CCN5iZkJiY2sNRawa6uQ==',key_name='tempest-keypair-1419521638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca10efde105d4ac08f0de89763f45e6d',ramdisk_id='',reservation_id='r-vsfllblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1588249025',owner_user_name='tempest-SnapshotDataIntegrityTests-1588249025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1b80e807664bbdbeeacb27dc5b131d',uuid=e849998f-c499-4cdd-b606-42851a46949b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converting VIF {"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'pci_devices' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 20:53:22 user nova-compute[72894]:   <uuid>e849998f-c499-4cdd-b606-42851a46949b</uuid>
Aug 16 20:53:22 user nova-compute[72894]:   <name>instance-00000034</name>
Aug 16 20:53:22 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 20:53:22 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 20:53:22 user nova-compute[72894]:   <metadata>
Aug 16 20:53:22 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 20:53:22 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-152954234</nova:name>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:creationTime>2023-08-16 20:53:22</nova:creationTime>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 20:53:22 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 20:53:22 user nova-compute[72894]:       </nova:flavor>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:owner>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:user uuid="8c1b80e807664bbdbeeacb27dc5b131d">tempest-SnapshotDataIntegrityTests-1588249025-project-member</nova:user>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:project uuid="ca10efde105d4ac08f0de89763f45e6d">tempest-SnapshotDataIntegrityTests-1588249025</nova:project>
Aug 16 20:53:22 user nova-compute[72894]:       </nova:owner>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 20:53:22 user nova-compute[72894]:       <nova:ports>
Aug 16 20:53:22 user nova-compute[72894]:         <nova:port uuid="23cd784f-b3d4-467c-9fe5-c9fa40ba15ef">
Aug 16 20:53:22 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 20:53:22 user nova-compute[72894]:         </nova:port>
Aug 16 20:53:22 user nova-compute[72894]:       </nova:ports>
Aug 16 20:53:22 user nova-compute[72894]:     </nova:instance>
Aug 16 20:53:22 user nova-compute[72894]:   </metadata>
Aug 16 20:53:22 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 20:53:22 user nova-compute[72894]:     <system>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="serial">e849998f-c499-4cdd-b606-42851a46949b</entry>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="uuid">e849998f-c499-4cdd-b606-42851a46949b</entry>
Aug 16 20:53:22 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 20:53:22 user nova-compute[72894]:     </system>
Aug 16 20:53:22 user nova-compute[72894]:   </sysinfo>
Aug 16 20:53:22 user nova-compute[72894]:   <os>
Aug 16 20:53:22 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 20:53:22 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 20:53:22 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 20:53:22 user nova-compute[72894]:   </os>
Aug 16 20:53:22 user nova-compute[72894]:   <features>
Aug 16 20:53:22 user nova-compute[72894]:     <acpi/>
Aug 16 20:53:22 user nova-compute[72894]:     <apic/>
Aug 16 20:53:22 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 20:53:22 user nova-compute[72894]:   </features>
Aug 16 20:53:22 user nova-compute[72894]:   <clock offset="utc">
Aug 16 20:53:22 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 20:53:22 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 20:53:22 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 20:53:22 user nova-compute[72894]:   </clock>
Aug 16 20:53:22 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 20:53:22 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 20:53:22 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 20:53:22 user nova-compute[72894]:   </cpu>
Aug 16 20:53:22 user nova-compute[72894]:   <devices>
Aug 16 20:53:22 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 20:53:22 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 20:53:22 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk"/>
Aug 16 20:53:22 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 20:53:22 user nova-compute[72894]:     </disk>
Aug 16 20:53:22 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 20:53:22 user nova-compute[72894]:       <mac address="fa:16:3e:bc:f9:a5"/>
Aug 16 20:53:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:53:22 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 20:53:22 user nova-compute[72894]:       <target dev="tap23cd784f-b3"/>
Aug 16 20:53:22 user nova-compute[72894]:     </interface>
Aug 16 20:53:22 user nova-compute[72894]:     <serial type="pty">
Aug 16 20:53:22 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/console.log" append="off"/>
Aug 16 20:53:22 user nova-compute[72894]:     </serial>
Aug 16 20:53:22 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 20:53:22 user nova-compute[72894]:     <video>
Aug 16 20:53:22 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 20:53:22 user nova-compute[72894]:     </video>
Aug 16 20:53:22 user nova-compute[72894]:     <rng model="virtio">
Aug 16 20:53:22 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 20:53:22 user nova-compute[72894]:     </rng>
Aug 16 20:53:22 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 20:53:22 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 20:53:22 user nova-compute[72894]:       <stats period="10"/>
Aug 16 20:53:22 user nova-compute[72894]:     </memballoon>
Aug 16 20:53:22 user nova-compute[72894]:   </devices>
Aug 16 20:53:22 user nova-compute[72894]: </domain>
Aug 16 20:53:22 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152954234',display_name='tempest-SnapshotDataIntegrityTests-server-152954234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152954234',id=52,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPb1iOXTifA9yfdzIVRifE4Wu5HpDwQ1ZX7JTg1YIo13v40ScVNEdtlycReQnpO1sO11yg1NRQQWib8f5wigMHhp9T18XvnC9db9R632+Bqv1CCN5iZkJiY2sNRawa6uQ==',key_name='tempest-keypair-1419521638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca10efde105d4ac08f0de89763f45e6d',ramdisk_id='',reservation_id='r-vsfllblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1588249025',owner_user_name='tempest-SnapshotDataIntegrityTests-1588249025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T20:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1b80e807664bbdbeeacb27dc5b131d',uuid=e849998f-c499-4cdd-b606-42851a46949b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converting VIF {"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG os_vif [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23cd784f-b3, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23cd784f-b3, col_values=(('external_ids', {'iface-id': '23cd784f-b3d4-467c-9fe5-c9fa40ba15ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:f9:a5', 'vm-uuid': 'e849998f-c499-4cdd-b606-42851a46949b'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:22 user nova-compute[72894]: INFO os_vif [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3')
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No VIF found with MAC fa:16:3e:bc:f9:a5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated VIF entry in instance network info cache for port 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG nova.network.neutron [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:53:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-76cf4a1b-b2e9-4299-98cf-c0dab3c8eff0 req-1fdbd6a3-10f4-44f1-afed-ea69513516ce service nova] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:23 user nova-compute[72894]: DEBUG nova.compute.manager [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] No waiting events found dispatching network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:53:23 user nova-compute[72894]: WARNING nova.compute.manager [req-2f973795-6d58-4f83-a03a-a682a87edbae req-775f920c-b490-41fc-811e-a741aba373da service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received unexpected event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef for instance with vm_state building and task_state spawning.
Aug 16 20:53:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:24 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:53:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:53:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=24.195133209228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692219205.915807, e849998f-c499-4cdd-b606-42851a46949b => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:53:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] VM Resumed (Lifecycle Event)
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 20:53:25 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] Instance spawned successfully.
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 20:53:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692219205.9170732, e849998f-c499-4cdd-b606-42851a46949b => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 20:53:25 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] VM Started (Lifecycle Event)
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:25 user nova-compute[72894]: DEBUG nova.compute.manager [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] No waiting events found dispatching network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 20:53:25 user nova-compute[72894]: WARNING nova.compute.manager [req-0c31401f-7dfb-483f-992c-e29f2133f41a req-0f6186b7-2f7f-4675-bb88-7c85c01d3376 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received unexpected event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef for instance with vm_state building and task_state spawning.
Aug 16 20:53:26 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 20:53:26 user nova-compute[72894]: INFO nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 16 20:53:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 20:53:26 user nova-compute[72894]: INFO nova.compute.manager [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Took 6.41 seconds to build instance.
Aug 16 20:53:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-23cd3404-ce0e-4c4f-841c-adcb45767e3e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:53:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:53:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:29 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:53:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:53:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:39 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:44 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:49 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:53:57 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:54:12 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:16 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:54:24 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:54:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:54:25 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=24.16619873046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:54:25 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:54:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:54:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:54:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:54:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:54:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:54:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:54:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:54:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:54:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:54:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:05 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:05 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:55:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-changed-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG nova.compute.manager [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Refreshing instance network info cache due to event network-changed-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Refreshing network info cache for port 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated VIF entry in instance network info cache for port 23cd784f-b3d4-467c-9fe5-c9fa40ba15ef. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG nova.network.neutron [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:55:10 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-cb10eb45-3244-4016-92e0-ef54afc04381 req-eabd066a-df8b-4e00-81b7-f9af78d05f02 service nova] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:55:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG nova.objects.instance [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:15 user nova-compute[72894]: INFO nova.compute.manager [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attaching volume 9b6e2265-9ac1-4bb0-9c56-e27701e667a3 to /dev/vdb
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.utils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aef1c1-b82c-412b-9bec-a70418760935]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[604ebea8-9ffb-4acd-bc83-17acf13a1605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ccc5f0-e38a-4825-bb25-1952eccc1388]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d0d48e-5a17-476d-adf2-1b089a99c4ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:55:15 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:55:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd0fda-ce11-4b4e-82f2-1b3acc60f4ac]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG os_brick.utils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:55:15 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating existing volume attachment record: d1d75b33-ddb2-46f2-b4a3-39ebbe3e969e {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:55:17 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:18 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:19 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 20:55:21 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYhuatBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:55:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:55:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:55:25 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[015fcdb9-0012-4240-92a1-8c2f35439782]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:55:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f603fb-5b2f-4576-b4a8-66667bf22544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3] added
Aug 16 20:55:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff02b97-782a-4071-8c42-2fba3ba4cff5]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d688ce9-5179-4c20-b00c-a1dec9db3e70]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYhuatBG {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYhuatBG" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7a300-6ed5-48b1-aba7-3bbd7ad92aa0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYhuatBG'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb6948a-d4d1-4483-a6bc-31631680f0d6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd1c8c-2cab-4acc-a0c6-14ae1379e31f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:55:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:55:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:55:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:55:25 user nova-compute[72894]: 
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2673d47a-1b14-45e6-920c-46c912cb4c42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260]
Aug 16 20:55:25 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260] successful.
Aug 16 20:55:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b4fc24-7ca1-4b42-b10c-1ebdb011580b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebccd24-47b5-4233-aced-782c941da275]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)
Aug 16 20:55:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)
Aug 16 20:55:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a5828e-5c23-4257-8396-817887697f04]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYhuatBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26533623638316436', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533623638316436', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:55:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:55:27 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:55:27 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:55:27 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:55:27 user nova-compute[72894]:   <serial>9b6e2265-9ac1-4bb0-9c56-e27701e667a3</serial>
Aug 16 20:55:27 user nova-compute[72894]: </disk>
Aug 16 20:55:27 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:55:27 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:55:27 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.165252685546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No VIF found with MAC fa:16:3e:bc:f9:a5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-49bfd1ed-5d97-4e4a-9cca-655b59d52d43 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.416s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.425s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:55:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:55:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:55:31 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:55:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:55:31 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:55:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:55:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:55:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:55:57 user nova-compute[72894]: INFO nova.compute.manager [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Detaching volume 9b6e2265-9ac1-4bb0-9c56-e27701e667a3
Aug 16 20:55:57 user nova-compute[72894]: INFO nova.virt.block_device [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attempting to driver detach volume 9b6e2265-9ac1-4bb0-9c56-e27701e667a3 from mountpoint /dev/vdb
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Attempting to detach device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:55:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:55:57 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:55:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:55:57 user nova-compute[72894]:   <serial>9b6e2265-9ac1-4bb0-9c56-e27701e667a3</serial>
Aug 16 20:55:57 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:55:57 user nova-compute[72894]: </disk>
Aug 16 20:55:57 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:55:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config.
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:55:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:55:57 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:55:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:55:57 user nova-compute[72894]:   <serial>9b6e2265-9ac1-4bb0-9c56-e27701e667a3</serial>
Aug 16 20:55:57 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:55:57 user nova-compute[72894]: </disk>
Aug 16 20:55:57 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219357.5696814, e849998f-c499-4cdd-b606-42851a46949b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:55:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config.
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYhuatBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:55:57 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[34583134-3c78-41b0-ab09-8f894d69c4cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d7edf-a44a-4613-88ba-ae3186d1f0e9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)
Aug 16 20:55:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 (non-flash)
Aug 16 20:55:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7998177a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8cc70b-f479-4e62-b5be-08b0b869f015]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde7743-3cec-4e8f-bb77-05a155c4facc]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b454069d-5e08-439b-acfb-ffb924b8b545]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a8696-ba0e-4a0e-9939-c516c1e9bb19]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8268e01-cfd1-466d-a00f-b095ffb28824]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc1393-e218-4dd8-ada1-53f95d6242d9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260]
Aug 16 20:55:57 user nova-compute[72894]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3, portal: 172.16.0.220,3260] successful.
Aug 16 20:55:57 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b6e2265-9ac1-4bb0-9c56-e27701e667a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[12754f5f-be00-4e1d-810e-e40e773abbf0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== disconnect_volume: return (259ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:55:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:55:58 user nova-compute[72894]: DEBUG nova.objects.instance [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:55:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-50f58276-0471-4e50-ac63-c3484ff9c9be tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.572s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:56:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:56:19 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:20 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:27 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:56:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:56:28 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.164173126220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:56:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:56:32 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:56:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:56:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:56:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:56:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:56:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:56:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:56:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:56:51 user nova-compute[72894]: INFO nova.compute.manager [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attaching volume fb851b4d-0d1a-43b7-853d-8dbdde86c208 to /dev/vdb
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.utils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7bf0f-3710-4f6e-a387-77f1a2a004b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8690e8-aa24-40ce-91af-9f0909cf550b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09efef-abd4-4391-a0f8-697b7c80dc46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b88d3-cbc3-4c78-a560-75c0aca191c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:56:51 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:56:51 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5fe75d-c52b-4479-9f79-88ac33e57ad4]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG os_brick.utils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:56:51 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating existing volume attachment record: 92d377e5-e7f5-43ba-bd40-e87d7f20bd91 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:56:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:56:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:56:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naIOHjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:57:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:57:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:57:01 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b78e76e-1741-4d5f-a297-2f97dcdc669b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:57:01 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0615dd21-e04d-4ef7-a9e8-69c1cdd0f50e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208] added
Aug 16 20:57:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311c4b5-ef4c-4846-b590-8f68d10bb2d4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebe07b-8850-4839-99b2-f574d239f825]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naIOHjGg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naIOHjGg" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[28574700-c7a4-459f-a94a-bb3865d003dc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'naIOHjGg'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7dbdc-31d9-406d-9308-e92ce6f4aac9]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddcbf7-0def-476d-a490-2bdc24413ce4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:57:01 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:57:01 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:57:01 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:57:01 user nova-compute[72894]: 
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e86cb-238e-40dc-a609-920970ff4563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260]
Aug 16 20:57:01 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260] successful.
Aug 16 20:57:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba434c6-c895-414a-a151-344fde235497]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[37006074-bb9c-4b02-a9df-a77d7a908831]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)
Aug 16 20:57:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)
Aug 16 20:57:01 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[80392a7f-c507-48a8-b96e-a388a16e7ace]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:57:01 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naIOHjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26361393663616333', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361393663616333', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:57:02 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:57:02 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:57:02 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:57:02 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:57:02 user nova-compute[72894]:   <serial>fb851b4d-0d1a-43b7-853d-8dbdde86c208</serial>
Aug 16 20:57:02 user nova-compute[72894]: </disk>
Aug 16 20:57:02 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:57:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:57:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:57:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No VIF found with MAC fa:16:3e:bc:f9:a5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:57:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fd2cfa0f-c958-4b30-8185-d672dacaf64f tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.967s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:57:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:57:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:57:05 user nova-compute[72894]: INFO nova.compute.manager [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Detaching volume fb851b4d-0d1a-43b7-853d-8dbdde86c208
Aug 16 20:57:05 user nova-compute[72894]: INFO nova.virt.block_device [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attempting to driver detach volume fb851b4d-0d1a-43b7-853d-8dbdde86c208 from mountpoint /dev/vdb
Aug 16 20:57:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Attempting to detach device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:57:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:57:05 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:57:05 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:57:05 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:57:05 user nova-compute[72894]:   <serial>fb851b4d-0d1a-43b7-853d-8dbdde86c208</serial>
Aug 16 20:57:05 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:57:05 user nova-compute[72894]: </disk>
Aug 16 20:57:05 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:57:05 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config.
Aug 16 20:57:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:57:05 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:57:05 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:57:05 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:57:05 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:57:05 user nova-compute[72894]:   <serial>fb851b4d-0d1a-43b7-853d-8dbdde86c208</serial>
Aug 16 20:57:05 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:57:05 user nova-compute[72894]: </disk>
Aug 16 20:57:05 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219426.2501113, e849998f-c499-4cdd-b606-42851a46949b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:57:06 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config.
Aug 16 20:57:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naIOHjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:57:06 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e798a777-b970-4b5c-ace0-2af167c6e36c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c793b-49cc-4143-aadd-e8dfd950e739]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)
Aug 16 20:57:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 (non-flash)
Aug 16 20:57:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c695900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee19d8-0829-4740-aae5-2bf061b511df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa112852-a72c-47b8-b3a1-3950a6775545]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a711814f-77ba-4540-8482-600b0be2788d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a9bdd-4548-4829-9cd1-ec1b3356b31a]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d594e636-e2c5-4595-abf4-f6a8e36e05a2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ede68-3790-4ce7-bf68-67606a690aca]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260]
Aug 16 20:57:06 user nova-compute[72894]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208, portal: 172.16.0.220,3260] successful.
Aug 16 20:57:06 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb851b4d-0d1a-43b7-853d-8dbdde86c208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a807237-5820-4414-b45f-183a8fc7c38b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== disconnect_volume: return (270ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:57:06 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:57:07 user nova-compute[72894]: DEBUG nova.objects.instance [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:57:07 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-28191652-b390-4c2c-b42e-eae15479ae9e tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:57:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:57:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:57:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:57:29 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:57:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:57:30 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=24.163116455078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:57:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:57:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:57:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:57:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:57:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:57:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:57:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:57:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:57:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:57:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:57:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:57:59 user nova-compute[72894]: DEBUG nova.objects.instance [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:57:59 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:58:00 user nova-compute[72894]: INFO nova.compute.manager [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attaching volume dc639e56-cd5c-4f92-957a-b2a4c23105de to /dev/vdb
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.utils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0f2ec-ac56-49bd-90f9-27b3053766c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309d8ba-6c56-4677-af04-f231e746ad1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51105e-8251-4bc2-98fb-bf58b59259a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc53a58-165d-48ec-9d1f-7c009c4eb489]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:58:00 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:58:00 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a8346-cd71-4433-b21e-826392361ff0]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG os_brick.utils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:58:00 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating existing volume attachment record: 31ef49bc-8945-4034-9220-d41486ffeb7d {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:58:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSMbRvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:58:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:58:09 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:58:09 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:58:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a937dab-18f0-4e25-b7b6-9545640c9a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:58:09 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:09 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[29572d55-49b3-4d77-ae1b-19628864425a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de] added
Aug 16 20:58:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b73159-71a6-4420-aaef-0e6eff21c56d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d768f05-7a89-4e0d-a6e6-315571331fcc]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APSMbRvz {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APSMbRvz" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26e761b-ad5e-4d3d-95d2-44e586323178]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APSMbRvz'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed2335-dd02-4c4c-8b56-e987491d4319]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9afb3c-4b65-472a-b18e-9df18b35e79c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:58:10 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:58:10 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:58:10 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:58:10 user nova-compute[72894]: 
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[45218e85-6807-4513-a071-6d2791de8c34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260]
Aug 16 20:58:10 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260] successful.
Aug 16 20:58:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d612c6d-3033-4f34-b3a0-53163dba762e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[18925564-625e-41e3-a4a3-f36365e3a222]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)
Aug 16 20:58:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)
Aug 16 20:58:10 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53edb74b-32e9-448e-85f5-44ee44781b9a]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:10 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSMbRvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26130303635363334', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130303635363334', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.objects.instance [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:58:11 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:58:11 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:58:11 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:58:11 user nova-compute[72894]:   <serial>dc639e56-cd5c-4f92-957a-b2a4c23105de</serial>
Aug 16 20:58:11 user nova-compute[72894]: </disk>
Aug 16 20:58:11 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No VIF found with MAC fa:16:3e:bc:f9:a5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:58:11 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-973c9d15-943a-43fd-807a-2547be5acb2c tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.738s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:58:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:58:14 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:58:14 user nova-compute[72894]: INFO nova.compute.manager [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Detaching volume dc639e56-cd5c-4f92-957a-b2a4c23105de
Aug 16 20:58:14 user nova-compute[72894]: INFO nova.virt.block_device [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attempting to driver detach volume dc639e56-cd5c-4f92-957a-b2a4c23105de from mountpoint /dev/vdb
Aug 16 20:58:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Attempting to detach device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:58:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:58:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:58:14 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:58:14 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:58:14 user nova-compute[72894]:   <serial>dc639e56-cd5c-4f92-957a-b2a4c23105de</serial>
Aug 16 20:58:14 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:58:14 user nova-compute[72894]: </disk>
Aug 16 20:58:14 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:58:14 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config.
Aug 16 20:58:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:58:14 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:58:14 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:58:14 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:58:14 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:58:14 user nova-compute[72894]:   <serial>dc639e56-cd5c-4f92-957a-b2a4c23105de</serial>
Aug 16 20:58:14 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:58:14 user nova-compute[72894]: </disk>
Aug 16 20:58:14 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219495.1430328, e849998f-c499-4cdd-b606-42851a46949b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:58:15 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config.
Aug 16 20:58:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSMbRvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:58:15 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7223bd33-4bca-4a63-80b5-6ca3b263a99e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f974c44-03b5-4cea-8df7-61c9ef3c5c93]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)
Aug 16 20:58:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de (non-flash)
Aug 16 20:58:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4ad5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48e0d5a-223f-4e93-b41f-5ba603c9c88a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f71978b-46d1-49dc-bb3d-e8e6388fa8d6]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[674eecd5-3e4b-4e60-8641-d017e3cc234c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7267ab1-73ae-425c-a39b-b7fb4a6076b9]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fcab5c-59c7-4449-97c4-20eb1bcfd0c6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a92499-1e80-4770-ad66-aabe4e137e42]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260]
Aug 16 20:58:15 user nova-compute[72894]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de, portal: 172.16.0.220,3260] successful.
Aug 16 20:58:15 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc639e56-cd5c-4f92-957a-b2a4c23105de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37730c8-18b5-45df-acf8-0f8d9b171b75]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== disconnect_volume: return (293ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:58:15 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:58:16 user nova-compute[72894]: DEBUG nova.objects.instance [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:58:16 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-73561471-0d03-43a2-80b6-ae7d9aa6cf08 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:58:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:22 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:58:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:58:32 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:58:32 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=24.162109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:58:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:58:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:58:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:58:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:58:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:58:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:58:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:59:08 user nova-compute[72894]: INFO nova.compute.manager [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attaching volume 92220262-cf8a-46be-8420-a2828937ef68 to /dev/vdb
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.utils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be0c4c-9021-4752-8972-50796887a8c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3265783-8ab8-4fbb-8658-69741083349b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e7b44-0972-427f-9773-730da5eefbda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d472f0-126e-4ef3-8831-de1b1beb9036]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 20:59:08 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 20:59:08 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3fa6e8-42d6-47a8-abb0-c653e6ae84cd]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG os_brick.utils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:59:08 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating existing volume attachment record: 513094e4-d7ce-40d9-b4aa-c3f82fad6d7c {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 20:59:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:23 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:24 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwUmlqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:59:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:59:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:59:25 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652070f-b3ec-4474-91fc-b45fbd3811ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 20:59:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b8796-b5a5-4456-b5e8-e965cc421725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68] added
Aug 16 20:59:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93489c9-549d-4bde-9b49-c1ab3024fc84]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04b846-b09c-4d7d-b171-78a6600543ee]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwUmlqPd {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwUmlqPd" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95af2fe-8318-41d3-8145-318a659a8b76]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwUmlqPd'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c32cd-ce5d-4dd7-b3b8-27a0c5f303da]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f35af2b-4740-4549-9b7f-8280c986594f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:59:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 20:59:25 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:59:25 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 20:59:25 user nova-compute[72894]: 
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f4d79-1bd0-479d-8404-26cd1c92c701]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260]
Aug 16 20:59:25 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260] successful.
Aug 16 20:59:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0231fc-2846-430f-aa80-72268aa6c6f6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a282493a-b8d9-4510-a390-46203f6a24ba]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)
Aug 16 20:59:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)
Aug 16 20:59:25 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aabe33-8795-4c70-8b9d-eb3171dd7615]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:25 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwUmlqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23466363062626532', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466363062626532', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 20:59:26 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:59:26 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:59:26 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:59:26 user nova-compute[72894]:   <serial>92220262-cf8a-46be-8420-a2828937ef68</serial>
Aug 16 20:59:26 user nova-compute[72894]: </disk>
Aug 16 20:59:26 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 20:59:26 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] No VIF found with MAC fa:16:3e:bc:f9:a5, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b74c1d04-33c8-4897-8189-aebb84604e29 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.334s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:59:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:59:29 user nova-compute[72894]: INFO nova.compute.manager [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Detaching volume 92220262-cf8a-46be-8420-a2828937ef68
Aug 16 20:59:29 user nova-compute[72894]: INFO nova.virt.block_device [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Attempting to driver detach volume 92220262-cf8a-46be-8420-a2828937ef68 from mountpoint /dev/vdb
Aug 16 20:59:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Attempting to detach device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 20:59:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:59:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:59:29 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:59:29 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:59:29 user nova-compute[72894]:   <serial>92220262-cf8a-46be-8420-a2828937ef68</serial>
Aug 16 20:59:29 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:59:29 user nova-compute[72894]: </disk>
Aug 16 20:59:29 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:59:29 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the persistent domain config.
Aug 16 20:59:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 20:59:29 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 20:59:29 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 20:59:29 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 20:59:29 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 20:59:29 user nova-compute[72894]:   <serial>92220262-cf8a-46be-8420-a2828937ef68</serial>
Aug 16 20:59:29 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 20:59:29 user nova-compute[72894]: </disk>
Aug 16 20:59:29 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219570.114557, e849998f-c499-4cdd-b606-42851a46949b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 20:59:30 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully detached device vdb from instance e849998f-c499-4cdd-b606-42851a46949b from the live domain config.
Aug 16 20:59:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwUmlqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 20:59:30 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc29c0f-f5c8-41ce-87a3-834d45e8d711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f10627-77bf-4bf6-87ce-a8428ac1c9de]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)
Aug 16 20:59:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 (non-flash)
Aug 16 20:59:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799055d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211b8d7-250a-4410-b7d8-e894ad9f341e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598f6f4-baa5-4de5-a8e9-09de1497eee2]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9a9a7-9ab3-4dae-99bd-723164b2079a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3562ff49-a153-4678-a573-508a2fffc846]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0df76a7-2a02-49f7-bd63-8f5cbdba27b6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d6f45d-b28f-46c9-8e8e-45b74beb348d]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260]
Aug 16 20:59:30 user nova-compute[72894]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68, portal: 172.16.0.220,3260] successful.
Aug 16 20:59:30 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92220262-cf8a-46be-8420-a2828937ef68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ecddf-6d37-4be0-b520-e1669e5a28eb]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] <== disconnect_volume: return (283ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 20:59:30 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 20:59:31 user nova-compute[72894]: DEBUG nova.objects.instance [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'flavor' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:59:31 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-bb8eb423-af54-4f5a-a628-9836b634a5f3 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:59:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 20:59:33 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 20:59:34 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:59:34 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.161052703857422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 20:59:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 20:59:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 20:59:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 20:59:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 20:59:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 20:59:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:09 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:09 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 21:00:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:25 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:00:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [{"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-e849998f-c499-4cdd-b606-42851a46949b" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:00:34 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:00:34 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:00:34 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=24.160316467285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:00:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance e849998f-c499-4cdd-b606-42851a46949b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:00:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:00:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:00:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:00:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:00:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:02 user nova-compute[72894]: INFO nova.compute.manager [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Terminating instance
Aug 16 21:01:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-unplugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] No waiting events found dispatching network-vif-unplugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [req-da326899-36b4-4e0e-8c67-b9586d2189ee req-e371c4c0-a104-4d7f-91be-c7626e41fa8e service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-unplugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] Instance destroyed successfully.
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.objects.instance [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lazy-loading 'resources' on Instance uuid e849998f-c499-4cdd-b606-42851a46949b {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T20:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152954234',display_name='tempest-SnapshotDataIntegrityTests-server-152954234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152954234',id=52,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPb1iOXTifA9yfdzIVRifE4Wu5HpDwQ1ZX7JTg1YIo13v40ScVNEdtlycReQnpO1sO11yg1NRQQWib8f5wigMHhp9T18XvnC9db9R632+Bqv1CCN5iZkJiY2sNRawa6uQ==',key_name='tempest-keypair-1419521638',keypairs=<?>,launch_index=0,launched_at=2023-08-16T20:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca10efde105d4ac08f0de89763f45e6d',ramdisk_id='',reservation_id='r-vsfllblr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1588249025',owner_user_name='tempest-SnapshotDataIntegrityTests-1588249025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T20:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1b80e807664bbdbeeacb27dc5b131d',uuid=e849998f-c499-4cdd-b606-42851a46949b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converting VIF {"id": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "address": "fa:16:3e:bc:f9:a5", "network": {"id": "a45b31e5-c4d8-44fc-80f6-58c3eae18080", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1415839177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca10efde105d4ac08f0de89763f45e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23cd784f-b3", "ovs_interfaceid": "23cd784f-b3d4-467c-9fe5-c9fa40ba15ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG os_vif [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23cd784f-b3, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:03 user nova-compute[72894]: INFO os_vif [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f9:a5,bridge_name='br-int',has_traffic_filtering=True,id=23cd784f-b3d4-467c-9fe5-c9fa40ba15ef,network=Network(a45b31e5-c4d8-44fc-80f6-58c3eae18080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23cd784f-b3')
Aug 16 21:01:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Deleting instance files /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b_del
Aug 16 21:01:03 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Deletion of /opt/stack/data/nova/instances/e849998f-c499-4cdd-b606-42851a46949b_del complete
Aug 16 21:01:03 user nova-compute[72894]: INFO nova.compute.manager [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] [instance: e849998f-c499-4cdd-b606-42851a46949b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 21:01:03 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 21:01:03 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 21:01:04 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:01:04 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] Took 1.14 seconds to deallocate network for instance.
Aug 16 21:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:04 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:04 user nova-compute[72894]: DEBUG nova.compute.manager [req-0fa5445d-870f-42d8-af2e-6cc2b2471c9a req-a8a1344f-98a1-4e0f-a31b-74673901d74b service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-deleted-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:01:04 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:05 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Deleted allocations for instance e849998f-c499-4cdd-b606-42851a46949b
Aug 16 21:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-40a5d997-1ece-4977-a47b-9045230ccc64 tempest-SnapshotDataIntegrityTests-1588249025 tempest-SnapshotDataIntegrityTests-1588249025-project-member] Lock "e849998f-c499-4cdd-b606-42851a46949b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] Acquiring lock "e849998f-c499-4cdd-b606-42851a46949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] Lock "e849998f-c499-4cdd-b606-42851a46949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:05 user nova-compute[72894]: DEBUG nova.compute.manager [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] No waiting events found dispatching network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:01:05 user nova-compute[72894]: WARNING nova.compute.manager [req-ec472d33-6fe8-4c0d-9064-f5b9b8ead335 req-963c39af-cec5-4465-8132-352b7cc4bf99 service nova] [instance: e849998f-c499-4cdd-b606-42851a46949b] Received unexpected event network-vif-plugged-23cd784f-b3d4-467c-9fe5-c9fa40ba15ef for instance with vm_state deleted and task_state None.
Aug 16 21:01:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692219663.6126184, e849998f-c499-4cdd-b606-42851a46949b => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 21:01:18 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: e849998f-c499-4cdd-b606-42851a46949b] VM Stopped (Lifecycle Event)
Aug 16 21:01:18 user nova-compute[72894]: DEBUG nova.compute.manager [None req-c99936d5-c56e-49d6-b514-60b30df72290 None None] [instance: e849998f-c499-4cdd-b606-42851a46949b] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:01:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:26 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:01:33 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=24.18755340576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:01:33 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:01:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:01:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:01:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 21:01:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:01:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:01:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:01:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:01:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:02:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:02:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:27 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:02:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:31 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:02:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:02:35 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:02:35 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=24.175033569335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:35 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:02:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:02:44 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:02:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Starting instance... {{(pid=72894) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72894) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 21:02:49 user nova-compute[72894]: INFO nova.compute.claims [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Claim successful on node user
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Start building networks asynchronously for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Allocating IP information in the background. {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] allocate_for_instance() {{(pid=72894) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 21:02:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Start building block device mappings for instance. {{(pid=72894) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.policy [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4a9bfac46f74614ad0c2165a0828ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff73073779d4fa09d121d689085ad23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72894) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Start spawning the instance on the hypervisor. {{(pid=72894) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Creating instance directory {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 21:02:49 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Creating image(s)
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "/opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "/opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "/opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:49 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.202s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "be6b726cf94573444641b4945e2cfab10c2c338f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.203s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk 1073741824 {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f,backing_fmt=raw /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk 1073741824" returned: 0 in 0.090s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "be6b726cf94573444641b4945e2cfab10c2c338f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6b726cf94573444641b4945e2cfab10c2c338f --force-share --output=json" returned: 0 in 0.210s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk. size=1073741824 {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG nova.virt.disk.api [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Cannot resize image /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk to a smaller size. {{(pid=72894) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG nova.objects.instance [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'migration_context' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Created local disks {{(pid=72894) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Ensure instance console log exists: /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/console.log {{(pid=72894) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:50 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:51 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Successfully created port: 6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Successfully updated port: 6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Building network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-changed-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.compute.manager [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Refreshing instance network info cache due to event network-changed-6518c446-9951-4805-b50f-d73db3a95174. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Instance cache missing network info. {{(pid=72894) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Instance network_info: |[{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72894) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.neutron [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Refreshing network info cache for port 6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Start _get_guest_xml network_info=[{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '60545238-42c7-459f-80c0-4238accb7183'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 21:02:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:02:52 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CPU controller missing on host. {{(pid=72894) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.host [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CPU controller found on host. {{(pid=72894) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72894) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T19:53:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:53:51Z,direct_url=<?>,disk_format='qcow2',id=60545238-42c7-459f-80c0-4238accb7183,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6bf837b97d74a57ac5b1ac44c5019d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:53:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flavor limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Image limits 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flavor pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Image pref 0:0:0 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Got 1 possible topologies {{(pid=72894) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.hardware [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72894) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T21:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-592972096',display_name='tempest-SnapshotDataIntegrityTests-server-592972096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-592972096',id=53,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFRAPP8jzBio3xn1F+UEXYMUvGisIePNCCrhiEqd5vjeryyV6zppFFlCUHyWSWMnPoUesweuMIocnfPWR0fnKnGZaxyOJ7fOFYffYWeYWeSSOPgKTjLZHQRjAaZm3t2rA==',key_name='tempest-keypair-1041847624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ff73073779d4fa09d121d689085ad23',ramdisk_id='',reservation_id='r-rr0779ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1375826350',owner_user_name='tempest-SnapshotDataIntegrityTests-1375826350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T21:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a9bfac46f74614ad0c2165a0828ea5',uuid=29f328cb-f1b3-417b-874c-cd9787434856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72894) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converting VIF {"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.objects.instance [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] End _get_guest_xml xml=<domain type="kvm">
Aug 16 21:02:52 user nova-compute[72894]:   <uuid>29f328cb-f1b3-417b-874c-cd9787434856</uuid>
Aug 16 21:02:52 user nova-compute[72894]:   <name>instance-00000035</name>
Aug 16 21:02:52 user nova-compute[72894]:   <memory>524288</memory>
Aug 16 21:02:52 user nova-compute[72894]:   <vcpu>1</vcpu>
Aug 16 21:02:52 user nova-compute[72894]:   <metadata>
Aug 16 21:02:52 user nova-compute[72894]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 21:02:52 user nova-compute[72894]:       <nova:package version="0.0.0"/>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-592972096</nova:name>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:creationTime>2023-08-16 21:02:52</nova:creationTime>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:flavor name="m1.tiny">
Aug 16 21:02:52 user nova-compute[72894]:         <nova:memory>512</nova:memory>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:disk>1</nova:disk>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:swap>0</nova:swap>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:vcpus>1</nova:vcpus>
Aug 16 21:02:52 user nova-compute[72894]:       </nova:flavor>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:owner>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:user uuid="f4a9bfac46f74614ad0c2165a0828ea5">tempest-SnapshotDataIntegrityTests-1375826350-project-member</nova:user>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:project uuid="5ff73073779d4fa09d121d689085ad23">tempest-SnapshotDataIntegrityTests-1375826350</nova:project>
Aug 16 21:02:52 user nova-compute[72894]:       </nova:owner>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:root type="image" uuid="60545238-42c7-459f-80c0-4238accb7183"/>
Aug 16 21:02:52 user nova-compute[72894]:       <nova:ports>
Aug 16 21:02:52 user nova-compute[72894]:         <nova:port uuid="6518c446-9951-4805-b50f-d73db3a95174">
Aug 16 21:02:52 user nova-compute[72894]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 21:02:52 user nova-compute[72894]:         </nova:port>
Aug 16 21:02:52 user nova-compute[72894]:       </nova:ports>
Aug 16 21:02:52 user nova-compute[72894]:     </nova:instance>
Aug 16 21:02:52 user nova-compute[72894]:   </metadata>
Aug 16 21:02:52 user nova-compute[72894]:   <sysinfo type="smbios">
Aug 16 21:02:52 user nova-compute[72894]:     <system>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="product">OpenStack Nova</entry>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="version">0.0.0</entry>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="serial">29f328cb-f1b3-417b-874c-cd9787434856</entry>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="uuid">29f328cb-f1b3-417b-874c-cd9787434856</entry>
Aug 16 21:02:52 user nova-compute[72894]:       <entry name="family">Virtual Machine</entry>
Aug 16 21:02:52 user nova-compute[72894]:     </system>
Aug 16 21:02:52 user nova-compute[72894]:   </sysinfo>
Aug 16 21:02:52 user nova-compute[72894]:   <os>
Aug 16 21:02:52 user nova-compute[72894]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 21:02:52 user nova-compute[72894]:     <boot dev="hd"/>
Aug 16 21:02:52 user nova-compute[72894]:     <smbios mode="sysinfo"/>
Aug 16 21:02:52 user nova-compute[72894]:   </os>
Aug 16 21:02:52 user nova-compute[72894]:   <features>
Aug 16 21:02:52 user nova-compute[72894]:     <acpi/>
Aug 16 21:02:52 user nova-compute[72894]:     <apic/>
Aug 16 21:02:52 user nova-compute[72894]:     <vmcoreinfo/>
Aug 16 21:02:52 user nova-compute[72894]:   </features>
Aug 16 21:02:52 user nova-compute[72894]:   <clock offset="utc">
Aug 16 21:02:52 user nova-compute[72894]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 21:02:52 user nova-compute[72894]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 21:02:52 user nova-compute[72894]:     <timer name="hpet" present="no"/>
Aug 16 21:02:52 user nova-compute[72894]:   </clock>
Aug 16 21:02:52 user nova-compute[72894]:   <cpu mode="custom" match="exact">
Aug 16 21:02:52 user nova-compute[72894]:     <model>Nehalem</model>
Aug 16 21:02:52 user nova-compute[72894]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 21:02:52 user nova-compute[72894]:   </cpu>
Aug 16 21:02:52 user nova-compute[72894]:   <devices>
Aug 16 21:02:52 user nova-compute[72894]:     <disk type="file" device="disk">
Aug 16 21:02:52 user nova-compute[72894]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 21:02:52 user nova-compute[72894]:       <source file="/opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk"/>
Aug 16 21:02:52 user nova-compute[72894]:       <target dev="vda" bus="virtio"/>
Aug 16 21:02:52 user nova-compute[72894]:     </disk>
Aug 16 21:02:52 user nova-compute[72894]:     <interface type="ethernet">
Aug 16 21:02:52 user nova-compute[72894]:       <mac address="fa:16:3e:b4:a1:5a"/>
Aug 16 21:02:52 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 21:02:52 user nova-compute[72894]:       <mtu size="1442"/>
Aug 16 21:02:52 user nova-compute[72894]:       <target dev="tap6518c446-99"/>
Aug 16 21:02:52 user nova-compute[72894]:     </interface>
Aug 16 21:02:52 user nova-compute[72894]:     <serial type="pty">
Aug 16 21:02:52 user nova-compute[72894]:       <log file="/opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/console.log" append="off"/>
Aug 16 21:02:52 user nova-compute[72894]:     </serial>
Aug 16 21:02:52 user nova-compute[72894]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 21:02:52 user nova-compute[72894]:     <video>
Aug 16 21:02:52 user nova-compute[72894]:       <model type="virtio"/>
Aug 16 21:02:52 user nova-compute[72894]:     </video>
Aug 16 21:02:52 user nova-compute[72894]:     <rng model="virtio">
Aug 16 21:02:52 user nova-compute[72894]:       <backend model="random">/dev/urandom</backend>
Aug 16 21:02:52 user nova-compute[72894]:     </rng>
Aug 16 21:02:52 user nova-compute[72894]:     <controller type="usb" index="0" model="none"/>
Aug 16 21:02:52 user nova-compute[72894]:     <memballoon model="virtio">
Aug 16 21:02:52 user nova-compute[72894]:       <stats period="10"/>
Aug 16 21:02:52 user nova-compute[72894]:     </memballoon>
Aug 16 21:02:52 user nova-compute[72894]:   </devices>
Aug 16 21:02:52 user nova-compute[72894]: </domain>
Aug 16 21:02:52 user nova-compute[72894]:  {{(pid=72894) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T21:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-592972096',display_name='tempest-SnapshotDataIntegrityTests-server-592972096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-592972096',id=53,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFRAPP8jzBio3xn1F+UEXYMUvGisIePNCCrhiEqd5vjeryyV6zppFFlCUHyWSWMnPoUesweuMIocnfPWR0fnKnGZaxyOJ7fOFYffYWeYWeSSOPgKTjLZHQRjAaZm3t2rA==',key_name='tempest-keypair-1041847624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ff73073779d4fa09d121d689085ad23',ramdisk_id='',reservation_id='r-rr0779ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1375826350',owner_user_name='tempest-SnapshotDataIntegrityTests-1375826350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T21:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a9bfac46f74614ad0c2165a0828ea5',uuid=29f328cb-f1b3-417b-874c-cd9787434856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converting VIF {"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG os_vif [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99') {{(pid=72894) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6518c446-99, may_exist=True, interface_attrs={}) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6518c446-99, col_values=(('external_ids', {'iface-id': '6518c446-9951-4805-b50f-d73db3a95174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:a1:5a', 'vm-uuid': '29f328cb-f1b3-417b-874c-cd9787434856'}),), if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:52 user nova-compute[72894]: INFO os_vif [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99')
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:02:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No VIF found with MAC fa:16:3e:b4:a1:5a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 21:02:53 user nova-compute[72894]: DEBUG nova.network.neutron [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated VIF entry in instance network info cache for port 6518c446-9951-4805-b50f-d73db3a95174. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 21:02:53 user nova-compute[72894]: DEBUG nova.network.neutron [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:02:53 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-720b5db2-029a-43e0-bb15-8b574c9180a6 req-eb133c4a-f8f6-4534-bae1-e9ffe01177f5 service nova] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:54 user nova-compute[72894]: DEBUG nova.compute.manager [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] No waiting events found dispatching network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:02:54 user nova-compute[72894]: WARNING nova.compute.manager [req-d5f2bb3f-1a67-45b6-a105-f6c58249e856 req-a4c43eb6-f12a-4ae2-a337-f5bfce830b01 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received unexpected event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 for instance with vm_state building and task_state spawning.
Aug 16 21:02:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:02:56 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:56 user nova-compute[72894]: DEBUG nova.compute.manager [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] No waiting events found dispatching network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:02:56 user nova-compute[72894]: WARNING nova.compute.manager [req-aa2bc4dc-74c2-4152-9cbe-db9156b72d7e req-d8121f86-605a-4460-bed9-b45b83a8fcf9 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received unexpected event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 for instance with vm_state building and task_state spawning.
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692219777.0008008, 29f328cb-f1b3-417b-874c-cd9787434856 => Resumed> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] VM Resumed (Lifecycle Event)
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Instance event wait completed in 0 seconds for  {{(pid=72894) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Guest created on hypervisor {{(pid=72894) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Instance spawned successfully.
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_cdrom_bus of ide {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_disk_bus of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_input_bus of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_pointer_model of None {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_video_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Found default for hw_vif_model of virtio {{(pid=72894) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.virt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Emitting event <LifecycleEvent: 1692219777.0027301, 29f328cb-f1b3-417b-874c-cd9787434856 => Started> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] VM Started (Lifecycle Event)
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72894) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 16 21:02:57 user nova-compute[72894]: DEBUG nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 21:02:57 user nova-compute[72894]: INFO nova.compute.manager [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Took 8.17 seconds to build instance.
Aug 16 21:02:57 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-719ee075-8ec2-4b4d-afbc-eaf17eca2355 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.318s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:02:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:30 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:03:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:03:37 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:03:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8521MB free_disk=24.141468048095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:03:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:44 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:03:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:03:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:03:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:03:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:28 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:04:36 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:04:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.13189697265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:04:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:04:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-changed-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:04:40 user nova-compute[72894]: DEBUG nova.compute.manager [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Refreshing instance network info cache due to event network-changed-6518c446-9951-4805-b50f-d73db3a95174. {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 21:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:04:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:04:40 user nova-compute[72894]: DEBUG nova.network.neutron [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Refreshing network info cache for port 6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 21:04:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated VIF entry in instance network info cache for port 6518c446-9951-4805-b50f-d73db3a95174. {{(pid=72894) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 21:04:41 user nova-compute[72894]: DEBUG nova.network.neutron [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:04:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-3c4cb256-b915-44d6-90db-f5fb959990dc req-d67b9496-126f-4248-99dc-8124f5e25a06 service nova] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:04:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:04:46 user nova-compute[72894]: INFO nova.compute.manager [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attaching volume 070337ec-4aa9-420d-ae5d-c454501df206 to /dev/vdb
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.utils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fa0c0-e76c-46ae-bcdf-bb453b6c64e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[01583bf2-d192-4684-b450-9b7f82008be9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9139ae43-9d91-4f45-abb0-7eee67635c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ab58e6-29e5-44ac-b884-0a3d0f1458a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:04:46 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 21:04:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[990a045c-5df1-4caa-9824-93eed258fe65]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG os_brick.utils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:04:46 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating existing volume attachment record: 52857f7c-c6e9-409f-9ecf-de1835328365 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 21:04:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:04:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvitcbGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:04:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:04:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:04:56 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6674f-5f0c-42d7-b7f8-230fab2df4cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 21:04:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed8f729-6d1f-4d5f-a4a7-558f0327b68c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206] added
Aug 16 21:04:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f516a6-06f8-416f-adaa-20b825542aaa]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a999642-86d2-4985-beb5-70337bde51b8]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvitcbGT {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvitcbGT" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322bdca-2ffb-4f69-8619-58e5bd0f741d]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CvitcbGT'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f7c80-391e-4114-ba63-267cb4e94758]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0a4d5-5aba-4d38-a8e4-0009b0db56c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:04:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:04:56 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:04:56 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 21:04:56 user nova-compute[72894]: 
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[159fbeda-4283-4cf7-b776-6eb85d3ee406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260]
Aug 16 21:04:56 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260] successful.
Aug 16 21:04:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab211ea8-57a3-4313-b4d8-9d68d9a251ad]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78ae9d-fa2a-4f62-9408-47d669b0e2af]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)
Aug 16 21:04:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)
Aug 16 21:04:56 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01ff2d-c6d9-456d-bbff-0b31c9c29bb4]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 21:04:56 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvitcbGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23433393862386639', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433393862386639', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.objects.instance [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 21:04:57 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:04:57 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:04:57 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:04:57 user nova-compute[72894]:   <serial>070337ec-4aa9-420d-ae5d-c454501df206</serial>
Aug 16 21:04:57 user nova-compute[72894]: </disk>
Aug 16 21:04:57 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:04:57 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No VIF found with MAC fa:16:3e:b4:a1:5a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-b8e8aee5-3645-4b74-9332-2ca87123f36d tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.729s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:04:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:00 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:02 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 21:05:02 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 21:05:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:05 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:10 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:15 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:21 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:21 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 21:05:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:05:27 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:05:27 user nova-compute[72894]: INFO nova.compute.manager [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Detaching volume 070337ec-4aa9-420d-ae5d-c454501df206
Aug 16 21:05:28 user nova-compute[72894]: INFO nova.virt.block_device [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attempting to driver detach volume 070337ec-4aa9-420d-ae5d-c454501df206 from mountpoint /dev/vdb
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Attempting to detach device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:05:28 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:05:28 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:05:28 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:05:28 user nova-compute[72894]:   <serial>070337ec-4aa9-420d-ae5d-c454501df206</serial>
Aug 16 21:05:28 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:05:28 user nova-compute[72894]: </disk>
Aug 16 21:05:28 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:05:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config.
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:05:28 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:05:28 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:05:28 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:05:28 user nova-compute[72894]:   <serial>070337ec-4aa9-420d-ae5d-c454501df206</serial>
Aug 16 21:05:28 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:05:28 user nova-compute[72894]: </disk>
Aug 16 21:05:28 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219928.50572, 29f328cb-f1b3-417b-874c-cd9787434856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 21:05:28 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config.
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvitcbGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:05:28 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc859e-9bc6-45f1-af32-05f1f1bce9ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbab81c-2e1b-418f-adaf-730a71ce281d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)
Aug 16 21:05:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 (non-flash)
Aug 16 21:05:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f799066e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[288e544c-5a3b-470c-a973-73eb9d4d8866]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd7220-d5c5-42bb-b387-a85c2a772756]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9284fa-513a-4ed1-a15d-596ae8bc3dee]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[010b5629-c2bf-4230-9e04-fc352b99eaef]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5489fed0-4ac0-4814-bcce-f4ee669dca63]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239aafa-3921-4f8c-89b3-f5dda516250e]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260]
Aug 16 21:05:28 user nova-compute[72894]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206, portal: 172.16.0.220,3260] successful.
Aug 16 21:05:28 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070337ec-4aa9-420d-ae5d-c454501df206 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586ded5-726b-46bf-aedf-49efc6dc7334]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== disconnect_volume: return (263ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:05:28 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Triggering sync for uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG nova.objects.instance [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-894d8855-0a85-40be-8d05-f801239655e0 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.119s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:05:29 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:05:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:32 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:05:37 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:05:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:05:38 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.13043975830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 21:05:38 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:05:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:46 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:05:46 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:05:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:05:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:06:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:06:22 user nova-compute[72894]: INFO nova.compute.manager [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attaching volume 5bbdda2e-6381-4a99-a009-26634743bb65 to /dev/vdb
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.utils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999552b-5144-4b19-b4d9-1f28b7c792df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca99f50-1df0-407e-bf5f-7b26b696dd98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a0d56-c1f0-4bf6-8350-5db58a531f5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e816dade-cc9e-4ef9-908a-622192df507e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:06:22 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 21:06:22 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a6409-e27f-460d-a8a4-90e60630ff6f]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG os_brick.utils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:06:22 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating existing volume attachment record: 8d509055-1f4c-4f6d-a549-310bf1a00d39 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 21:06:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:25 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOoQScVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:06:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:06:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:06:32 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6dc23-4f86-4e63-b4f1-d52522a63363]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 21:06:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912a38a-db63-41e9-b6a4-16aae9b421af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65] added
Aug 16 21:06:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0931d-83e9-4465-a7c3-a669e82dc5d4]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f240d33-7622-46c1-a89a-46c4798aa6c6]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOoQScVH {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOoQScVH" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992177d-8f77-40bf-99a1-025a4070d744]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOoQScVH'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe63a8-9a0c-48c3-9e45-f821024c317e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bdbc41-2231-4375-96f3-2aca800260f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:06:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:06:32 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:06:32 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 21:06:32 user nova-compute[72894]: 
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5867e9-a4cd-4870-b264-cd11ee36ea33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260]
Aug 16 21:06:32 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260] successful.
Aug 16 21:06:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a0fcc2-9514-424b-ab53-da03e144574b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf087d21-378c-48dd-a789-e8a062f16e94]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)
Aug 16 21:06:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)
Aug 16 21:06:32 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd3b40-1038-4f35-b654-e2af3155b377]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 21:06:32 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOoQScVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26139643436363939', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139643436363939', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG nova.objects.instance [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:06:33 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 21:06:33 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:06:33 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:06:33 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:06:33 user nova-compute[72894]:   <serial>5bbdda2e-6381-4a99-a009-26634743bb65</serial>
Aug 16 21:06:33 user nova-compute[72894]: </disk>
Aug 16 21:06:33 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 21:06:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:06:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:06:34 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No VIF found with MAC fa:16:3e:b4:a1:5a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 21:06:34 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-c129d408-6974-401e-b334-2a6569ccf6ea tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.912s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:06:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:06:36 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:06:36 user nova-compute[72894]: INFO nova.compute.manager [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Detaching volume 5bbdda2e-6381-4a99-a009-26634743bb65
Aug 16 21:06:36 user nova-compute[72894]: INFO nova.virt.block_device [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attempting to driver detach volume 5bbdda2e-6381-4a99-a009-26634743bb65 from mountpoint /dev/vdb
Aug 16 21:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Attempting to detach device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 21:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:06:36 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:06:36 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:06:36 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:06:36 user nova-compute[72894]:   <serial>5bbdda2e-6381-4a99-a009-26634743bb65</serial>
Aug 16 21:06:36 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:06:36 user nova-compute[72894]: </disk>
Aug 16 21:06:36 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:06:36 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config.
Aug 16 21:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 21:06:36 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:06:36 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:06:36 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:06:36 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:06:36 user nova-compute[72894]:   <serial>5bbdda2e-6381-4a99-a009-26634743bb65</serial>
Aug 16 21:06:36 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:06:36 user nova-compute[72894]: </disk>
Aug 16 21:06:36 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692219997.1890535, 29f328cb-f1b3-417b-874c-cd9787434856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 21:06:37 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config.
Aug 16 21:06:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOoQScVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:06:37 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3ac50-afa0-4d06-8d4b-551f5ce22947]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc4fa63-e586-4255-807e-6fefc8e7bf94]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)
Aug 16 21:06:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 (non-flash)
Aug 16 21:06:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990495000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2bd5f-273d-4fdb-bdc5-2da5dfcf8762]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19848b2-09fa-4dff-821f-592bc6fc0c07]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46d17c-12c4-4156-99ff-03daf8104f6b]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed1ce1-26fb-4f56-ada1-869f4dce4399]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b67670-2ac4-4342-aca8-a6bc7874f118]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afec47-066a-4cd7-8729-1bcf7b88c959]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260]
Aug 16 21:06:37 user nova-compute[72894]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65, portal: 172.16.0.220,3260] successful.
Aug 16 21:06:37 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bbdda2e-6381-4a99-a009-26634743bb65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f59f66-5a61-4350-857c-85a96afebe5e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== disconnect_volume: return (276ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:06:37 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-26deb416-9ed8-4f1d-a3e0-485e280e52f9 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:06:38 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:06:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:06:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:06:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.12948226928711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:06:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:06:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:06:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:48 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:48 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:06:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:06:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:06:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:07:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:07:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:07:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG nova.objects.instance [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:07:30 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:07:30 user nova-compute[72894]: INFO nova.compute.manager [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attaching volume 6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 to /dev/vdb
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.utils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5532c80-b53e-4176-9b95-a30b65e40033]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a9a22-7c6b-46a9-99ee-218bdd9a4a58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa1716-deeb-4819-83c2-0d3d52a6a212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16aa93f-5b36-497f-8d28-2c17371fdbce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:07:31 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 21:07:31 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[47761c1b-18e6-4794-87a7-8102ab6f46d9]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG os_brick.utils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:07:31 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating existing volume attachment record: cca5ff9e-54ae-4feb-9f99-20ce2273bbaf {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 21:07:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:35 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:38 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:39 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:07:39 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=24.12869644165039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:07:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xykJpQdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:07:40 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:07:40 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:07:40 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b773311-7545-4a48-a364-b4a1aa1571bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 21:07:40 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7628b5a-d4b9-498a-8998-33b7ed3ce179]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170] added
Aug 16 21:07:40 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[908a7dd8-9817-49f8-a096-258419e11c79]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f714d-8815-425c-9769-5b76bf29ffad]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xykJpQdg {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xykJpQdg" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd3330-46be-4e41-ac2e-e9e19f99524a]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xykJpQdg'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86949f-3eb7-4aa1-bcd6-b14fb8ead431]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeec66d-95c5-457e-b35b-a1801e6f6111]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:07:40 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:07:40 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:07:40 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 21:07:40 user nova-compute[72894]: 
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[94750d04-0939-4b48-b2da-856d78877b4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260]
Aug 16 21:07:40 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260] successful.
Aug 16 21:07:40 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[85df9200-13de-4cc0-ae47-89ecee295cac]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63bae9e-e159-45ca-b1e3-68b280738210]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)
Aug 16 21:07:41 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)
Aug 16 21:07:41 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ab5cbd-4a0c-4a7b-b2e3-12980af8d791]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:07:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xykJpQdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26639386539626633', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639386539626633', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.objects.instance [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 21:07:42 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:07:42 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:07:42 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:07:42 user nova-compute[72894]:   <serial>6b8dbaf3-17b9-4fcc-b785-75c51aa2a170</serial>
Aug 16 21:07:42 user nova-compute[72894]: </disk>
Aug 16 21:07:42 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No VIF found with MAC fa:16:3e:b4:a1:5a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 21:07:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-33f17c3e-4350-49ab-9c6e-fdc4ce441766 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.741s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:07:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:45 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:07:45 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:07:45 user nova-compute[72894]: INFO nova.compute.manager [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Detaching volume 6b8dbaf3-17b9-4fcc-b785-75c51aa2a170
Aug 16 21:07:45 user nova-compute[72894]: INFO nova.virt.block_device [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attempting to driver detach volume 6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 from mountpoint /dev/vdb
Aug 16 21:07:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Attempting to detach device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 21:07:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:07:45 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:07:45 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:07:45 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:07:45 user nova-compute[72894]:   <serial>6b8dbaf3-17b9-4fcc-b785-75c51aa2a170</serial>
Aug 16 21:07:45 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:07:45 user nova-compute[72894]: </disk>
Aug 16 21:07:45 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:07:45 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config.
Aug 16 21:07:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 21:07:45 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:07:45 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:07:45 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:07:45 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:07:45 user nova-compute[72894]:   <serial>6b8dbaf3-17b9-4fcc-b785-75c51aa2a170</serial>
Aug 16 21:07:45 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:07:45 user nova-compute[72894]: </disk>
Aug 16 21:07:45 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692220066.0109208, 29f328cb-f1b3-417b-874c-cd9787434856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 21:07:46 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config.
Aug 16 21:07:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xykJpQdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:07:46 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640a82b-257d-42da-b875-51469c7530a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6682972-de84-432b-af75-ab6ba1a4fb5f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)
Aug 16 21:07:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 (non-flash)
Aug 16 21:07:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7990602680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[87714ea8-2399-4592-ae71-33bb23cca3a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5828bdd4-aad7-4d2c-b963-0b91eb36d167]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b81472d-c108-42c7-8f5a-ee318423c2c0]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b759a-b6da-44e2-b285-a79445c3e206]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[03774b26-9e4b-43ff-b5c5-df545205fd6e]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[33715e46-1b0a-4ed1-8c8c-4ac8040a37a4]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260]
Aug 16 21:07:46 user nova-compute[72894]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170, portal: 172.16.0.220,3260] successful.
Aug 16 21:07:46 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b8dbaf3-17b9-4fcc-b785-75c51aa2a170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09829b-c3b5-41c8-80d2-267df5631a99]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== disconnect_volume: return (262ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:07:46 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 21:07:47 user nova-compute[72894]: DEBUG nova.objects.instance [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:07:47 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-0a38ed95-0622-4a09-a361-1034037941d8 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:07:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:07:49 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:07:50 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:07:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:08:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:08:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:30 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:08:39 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:08:39 user nova-compute[72894]: INFO nova.compute.manager [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attaching volume 73c20475-723b-443b-ae78-397587349a7e to /dev/vdb
Aug 16 21:08:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:08:40 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=24.127811431884766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.utils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c912d8-d077-484d-8ec6-47e9e0b444c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:99a73c15fd90\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc9d11c-8d34-49ea-97a3-46deae7e4c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6318b9-7d99-499a-bf6b-2c6ac6ff6c12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f952a-577c-4695-af8d-8935fedfeef1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Running cmd (subprocess): nvme version {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] nvme not present on system {{(pid=72894) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 21:08:40 user nova-compute[72894]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a0fd7-aea1-4073-b229-db5d3adea71d]: (4, '') {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72894) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.lightos [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] LIGHTOS: no hostnqn found. {{(pid=72894) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG os_brick.utils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:99a73c15fd90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.virt.block_device [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating existing volume attachment record: 401927b6-24aa-4fd4-959e-6d0b5158f303 {{(pid=72894) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:08:40 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:08:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:08:42 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:08:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:08:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:08:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:49 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Calling os-brick to attach iSCSI Volume {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrcQAqBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:08:50 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:08:50 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:08:50 user nova-compute[72894]: INFO os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c80d5-da2d-4e8e-afec-fba6503ee5e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 21:08:50 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --interface default --op new {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e03ed1-9bed-4ed5-9531-9c35c6e41cbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e] added\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e] added
Aug 16 21:08:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe6d9a-fc66-4f6a-9ac7-06e3c2a7e005]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bee73b-72dc-41d7-b863-923ed3a16f8f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrcQAqBE {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrcQAqBE" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2787d-5440-44ea-99f0-7b13b56948b2]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrcQAqBE'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705b700-537c-4769-9ddf-cf75fabbc87f]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa509b9-0698-4588-8b3c-656c2b96f8dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:08:50 user nova-compute[72894]:  {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 21:08:50 user nova-compute[72894]:  {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:08:50 user nova-compute[72894]: WARNING os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 21:08:50 user nova-compute[72894]: 
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --login {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1934fc-9748-4c21-afec-80fe5e907475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260]
Aug 16 21:08:50 user nova-compute[72894]: Login to [iface: default, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260] successful.
Aug 16 21:08:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc17b8-bf42-45f6-a831-42658f766100]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c50038-fd75-4c30-8807-6ede5605bf1b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)
Aug 16 21:08:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)
Aug 16 21:08:50 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.501s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to 172.16.0.220:3260 {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72894) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72894) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3440efa7-df19-4622-bfc8-003428db4c52]: (4, ('- - 0', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72894) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 21:08:50 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrcQAqBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72894) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 21:08:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:08:51 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== connect_volume: return (1531ms) {'type': 'block', 'scsi_wwn': '26263626164303433', 'path': '/dev/sdb'} {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:08:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263626164303433', 'path': '/dev/sdb'} {{(pid=72894) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 21:08:51 user nova-compute[72894]: DEBUG nova.objects.instance [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:08:51 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 21:08:51 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:08:51 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:08:51 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:08:51 user nova-compute[72894]:   <serial>73c20475-723b-443b-ae78-397587349a7e</serial>
Aug 16 21:08:51 user nova-compute[72894]: </disk>
Aug 16 21:08:51 user nova-compute[72894]:  {{(pid=72894) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 21:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vda, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72894) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 21:08:52 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] No VIF found with MAC fa:16:3e:b4:a1:5a, not building metadata {{(pid=72894) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 21:08:52 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-fef5a204-de07-4ee9-961d-f6d4542f2bc7 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.294s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:08:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:08:54 user nova-compute[72894]: INFO nova.compute.manager [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Detaching volume 73c20475-723b-443b-ae78-397587349a7e
Aug 16 21:08:54 user nova-compute[72894]: INFO nova.virt.block_device [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Attempting to driver detach volume 73c20475-723b-443b-ae78-397587349a7e from mountpoint /dev/vdb
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Attempting to detach device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config. {{(pid=72894) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:08:54 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:08:54 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:08:54 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:08:54 user nova-compute[72894]:   <serial>73c20475-723b-443b-ae78-397587349a7e</serial>
Aug 16 21:08:54 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:08:54 user nova-compute[72894]: </disk>
Aug 16 21:08:54 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:08:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the persistent domain config.
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config. {{(pid=72894) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.guest [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 21:08:54 user nova-compute[72894]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 21:08:54 user nova-compute[72894]:   <source dev="/dev/sdb"/>
Aug 16 21:08:54 user nova-compute[72894]:   <target dev="vdb" bus="virtio"/>
Aug 16 21:08:54 user nova-compute[72894]:   <serial>73c20475-723b-443b-ae78-397587349a7e</serial>
Aug 16 21:08:54 user nova-compute[72894]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 21:08:54 user nova-compute[72894]: </disk>
Aug 16 21:08:54 user nova-compute[72894]:  {{(pid=72894) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-fa3cc051-7aa8-453b-ba5f-034dd8fe2da1 None None] Received event <DeviceRemovedEvent: 1692220134.8185065, 29f328cb-f1b3-417b-874c-cd9787434856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72894) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.driver [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 21:08:54 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully detached device vdb from instance 29f328cb-f1b3-417b-874c-cd9787434856 from the live domain config.
Aug 16 21:08:54 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] calling os-brick to detach iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79905077f0>, {'target_iqns': ['iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrcQAqBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 21:08:54 user nova-compute[72894]: WARNING os_brick.initiator.connectors.base [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e', 0)] {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da7c0b-8e77-4d58-af4f-05a915a0de62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d65e6-5f10-4702-ad2a-5d33598eec6f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)
Aug 16 21:08:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e (non-flash)
Aug 16 21:08:54 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f796c34c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e'): ({'sdb'}, set())}) {{(pid=72894) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Removing single pathed devices sdb {{(pid=72894) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0c18a-00af-4e94-9174-e078724ce60f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c8c1e6-ac66-4c9c-9741-f1869274d637]: (4, ('ok\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Flushing IO for device /dev/sdb {{(pid=72894) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b6763-7681-4f45-8fe8-58d9cb704780]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72894) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d4978-369a-4e22-b11b-3e4eda7816dd]: (4, ('1', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.linuxscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] SCSI volumes sdb have been removed. {{(pid=72894) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e')] {{(pid=72894) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 21:08:54 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb37f1f-43ca-4eff-9ec5-7e8fb991338c]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --logout {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b26395-f20c-4f4a-94e3-e28284d7113d]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260]
Aug 16 21:08:55 user nova-compute[72894]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e, portal: 172.16.0.220,3260] successful.
Aug 16 21:08:55 user nova-compute[72894]:  stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op delete {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73c20475-723b-443b-ae78-397587349a7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915ed86-842f-4282-ae04-2585286e7b16]: (4, ('', '')) {{(pid=83840) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72894) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.base [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] <== disconnect_volume: return (265ms) None {{(pid=72894) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Disconnected iSCSI Volume {{(pid=72894) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG nova.objects.instance [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'flavor' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:08:55 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-4083898d-ed57-4d2a-bc84-01e3b23b1431 tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:08:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:28 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:31 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:33 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:34 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:38 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquired lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Forcefully refreshing network info cache for instance {{(pid=72894) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.objects.instance [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lazy-loading 'info_cache' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.network.neutron [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [{"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Releasing lock "refresh_cache-29f328cb-f1b3-417b-874c-cd9787434856" {{(pid=72894) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updated the network info_cache for instance {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:09:41 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.processutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72894) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 21:09:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:09:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=24.126876831054688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Instance 29f328cb-f1b3-417b-874c-cd9787434856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72894) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:09:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:09:43 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:48 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:09:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:09:53 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:09:58 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:03 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:08 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:13 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:14 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 21:10:14 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] There are 0 instances to clean {{(pid=72894) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 21:10:18 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:26 user nova-compute[72894]: INFO nova.compute.manager [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Terminating instance
Aug 16 21:10:26 user nova-compute[72894]: DEBUG nova.compute.manager [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Start destroying the instance on the hypervisor. {{(pid=72894) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-unplugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] No waiting events found dispatching network-vif-unplugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:10:26 user nova-compute[72894]: DEBUG nova.compute.manager [req-77699a20-2e3d-45a9-83ca-21021ce27df5 req-8aa0db1f-7d49-40f1-acc2-aadf632eccfd service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-unplugged-6518c446-9951-4805-b50f-d73db3a95174 for instance with task_state deleting. {{(pid=72894) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Instance destroyed successfully.
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.objects.instance [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lazy-loading 'resources' on Instance uuid 29f328cb-f1b3-417b-874c-cd9787434856 {{(pid=72894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.virt.libvirt.vif [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T21:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-592972096',display_name='tempest-SnapshotDataIntegrityTests-server-592972096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-592972096',id=53,image_ref='60545238-42c7-459f-80c0-4238accb7183',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFRAPP8jzBio3xn1F+UEXYMUvGisIePNCCrhiEqd5vjeryyV6zppFFlCUHyWSWMnPoUesweuMIocnfPWR0fnKnGZaxyOJ7fOFYffYWeYWeSSOPgKTjLZHQRjAaZm3t2rA==',key_name='tempest-keypair-1041847624',keypairs=<?>,launch_index=0,launched_at=2023-08-16T21:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ff73073779d4fa09d121d689085ad23',ramdisk_id='',reservation_id='r-rr0779ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60545238-42c7-459f-80c0-4238accb7183',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1375826350',owner_user_name='tempest-SnapshotDataIntegrityTests-1375826350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T21:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a9bfac46f74614ad0c2165a0828ea5',uuid=29f328cb-f1b3-417b-874c-cd9787434856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converting VIF {"id": "6518c446-9951-4805-b50f-d73db3a95174", "address": "fa:16:3e:b4:a1:5a", "network": {"id": "0800d8e1-1a57-454f-a2c9-9430e1c9e108", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1615423284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ff73073779d4fa09d121d689085ad23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6518c446-99", "ovs_interfaceid": "6518c446-9951-4805-b50f-d73db3a95174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.network.os_vif_util [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99') {{(pid=72894) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG os_vif [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99') {{(pid=72894) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6518c446-99, bridge=br-int, if_exists=True) {{(pid=72894) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:27 user nova-compute[72894]: INFO os_vif [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:a1:5a,bridge_name='br-int',has_traffic_filtering=True,id=6518c446-9951-4805-b50f-d73db3a95174,network=Network(0800d8e1-1a57-454f-a2c9-9430e1c9e108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6518c446-99')
Aug 16 21:10:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Deleting instance files /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856_del
Aug 16 21:10:27 user nova-compute[72894]: INFO nova.virt.libvirt.driver [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Deletion of /opt/stack/data/nova/instances/29f328cb-f1b3-417b-874c-cd9787434856_del complete
Aug 16 21:10:27 user nova-compute[72894]: INFO nova.compute.manager [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 21:10:27 user nova-compute[72894]: DEBUG oslo.service.loopingcall [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72894) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.compute.manager [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Deallocating network for instance {{(pid=72894) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 21:10:27 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] deallocate_for_instance() {{(pid=72894) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.network.neutron [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Updating instance_info_cache with network_info: [] {{(pid=72894) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 21:10:28 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Took 1.17 seconds to deallocate network for instance.
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-e967c02e-fb20-4322-901c-3440f26f903a req-e8d4431e-83a0-47b6-8d80-b49d74f8bb2d service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-deleted-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:28 user nova-compute[72894]: INFO nova.scheduler.client.report [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Deleted allocations for instance 29f328cb-f1b3-417b-874c-cd9787434856
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-7574732a-3b85-4447-8e7c-8c5bd93464ba tempest-SnapshotDataIntegrityTests-1375826350 tempest-SnapshotDataIntegrityTests-1375826350-project-member] Lock "29f328cb-f1b3-417b-874c-cd9787434856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] Acquiring lock "29f328cb-f1b3-417b-874c-cd9787434856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] Lock "29f328cb-f1b3-417b-874c-cd9787434856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:28 user nova-compute[72894]: DEBUG nova.compute.manager [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] No waiting events found dispatching network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 {{(pid=72894) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 21:10:28 user nova-compute[72894]: WARNING nova.compute.manager [req-1940f9f0-0cfa-48fb-82e6-f8d233846137 req-82b84345-2e71-4353-8500-46bf982f7234 service nova] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Received unexpected event network-vif-plugged-6518c446-9951-4805-b50f-d73db3a95174 for instance with vm_state deleted and task_state None.
Aug 16 21:10:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:33 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72894) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 21:10:35 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:10:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:38 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:41 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692220227.1938376, 29f328cb-f1b3-417b-874c-cd9787434856 => Stopped> {{(pid=72894) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 21:10:42 user nova-compute[72894]: INFO nova.compute.manager [-] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] VM Stopped (Lifecycle Event)
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-612c22d4-57d6-4854-affe-778ca75d5062 None None] [instance: 29f328cb-f1b3-417b-874c-cd9787434856] Checking state {{(pid=72894) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:10:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:10:42 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.153915405273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing inventories for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating ProviderTree inventory for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Updating inventory in ProviderTree for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing aggregate associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, aggregates: None {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Refreshing trait associations for resource provider 3aeddb5a-5151-4ab0-bd05-66d638b30977, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72894) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:10:42 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:10:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:10:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:10:47 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:51 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:51 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72894) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 21:10:52 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:10:53 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:10:57 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:02 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:07 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:11:12 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:11:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:17 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:20 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:22 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:23 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:27 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:32 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:33 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:36 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:37 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:39 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72894) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72894) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72894) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Starting heal instance info cache {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Rebuilding the list of instances to heal {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 21:11:42 user nova-compute[72894]: DEBUG nova.compute.manager [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Didn't find any instances for network info cache update. {{(pid=72894) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_service.periodic_task [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72894) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Auditing locally available compute resources for user (node: user) {{(pid=72894) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 21:11:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:11:43 user nova-compute[72894]: WARNING nova.virt.libvirt.driver [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.12281036376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72894) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72894) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.provider_tree [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed in ProviderTree for provider: 3aeddb5a-5151-4ab0-bd05-66d638b30977 {{(pid=72894) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.scheduler.client.report [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Inventory has not changed for provider 3aeddb5a-5151-4ab0-bd05-66d638b30977 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72894) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG nova.compute.resource_tracker [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Compute_service record updated for user:user {{(pid=72894) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 21:11:43 user nova-compute[72894]: DEBUG oslo_concurrency.lockutils [None req-f83ed681-d84c-4509-baea-a05cae822179 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72894) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}